Classifying contacts or associations with a touch sensitive device

ABSTRACT

Techniques enabling improved classification of objects against a touch sensitive surface of a touch sensitive device are presented. An object classification component can analyze touch screen data associated with a touch sensitive surface associated with a device and motion information relating to motion along at least one axis associated with the device. The object classification component can determine a contact classification for an object with respect to the touch sensitive surface, based on a result(s) of the analyzing, and in response to determining a contact state of the object with respect to the touch sensitive surface. An event determination component can control a function associated with the touch sensitive surface based on the contact classification for the object, the function comprising enabling or disabling a touch sensitive function of the touch sensitive surface of a display screen of the device or switching the display screen on or off.

CROSS REFERENCES TO RELATED APPLICATIONS

This application is a continuation-in-part of, and claims priority to,U.S. application Ser. No. 14/684,407, filed on Apr. 12, 2015, and thisapplication and U.S. application Ser. No. 14/684,407 each claim priorityto U.S. Provisional Patent Application No. 62/055,416, filed on Sep. 25,2014, each of which applications is incorporated in their entiretyherein by reference. Further, cross-reference is made to the followingcommonly assigned and co-pending U.S. patent applications: U.S. patentapplication Ser. No. 14/612,089, entitled “Method and Apparatus forClassifying Finger Touch Events on a Touch Screen,” filed on Feb. 2,2015, U.S. patent application Ser. No. 13/958,427 entitled “Capture ofVibro-Acoustic Data used to Determine Touch Types,” filed on Aug. 2,2013, U.S. patent application Ser. No. 13/780,494, entitled “Input ToolsHaving Vibro-Acoustically Distinct Regions and Computing Device For UseWith Same,” filed on Feb. 28, 2013, U.S. patent application Ser. No.13/849,698, entitled “Method and System For Activating DifferentInteractive Functions Using Different Types of Finger Contact,” filed onMar. 25, 2013, U.S. patent application Ser. No. 14/219,919, entitled“Method and Device for Sensing Touch Inputs,” filed on Mar. 19, 2014,U.S. patent application Ser. No. 13/887,711 entitled “Using Finger TouchTypes to Interact with Electronic Devices,” filed on May 6, 2013 andU.S. patent application Ser. No. 14/191,329 entitled “Using CapacitiveImages for Touch Type Classification,” filed on Feb. 26, 2014, each ofwhich applications is incorporated in their entirety herein byreference.

COPYRIGHT NOTICE

A portion of the disclosure of this patent document contains materialwhich is subject to copyright protection. The copyright owner has noobjection to the facsimile reproduction by anyone of the patent documentor the patent disclosure, as it appears in the Patent and TrademarkOffice patent file or records, but otherwise reserves all copyrightrights whatsoever.

TECHNICAL FIELD

This disclosure relates generally to touch surface technology, e.g.,classifying contacts or associations with a touch sensitive device.

BACKGROUND

Various electronic devices today typically can be operated by a userinteracting with a touch screen. This feature is particularly acharacteristic of the recent generation of smart phones. Typically,touch display screens can respond to finger contact to activate thetouch display screen for further processes. Contact also may be madewith the touch display screen using tools such as a stylus, other partsof the hand such as the palm and various parts of the finger.

The above-described description is merely intended to provide acontextual overview relating to touch sensitive devices, and is notintended to be exhaustive.

SUMMARY

The following presents a simplified summary of the specification inorder to provide a basic understanding of some aspects of thespecification. This summary is not an extensive overview of thespecification. It is intended to neither identify key or criticalelements of the specification, nor delineate any scope of the particularimplementations of the specification or any scope of the claims. Itssole purpose is to present some concepts of the specification in asimplified form as a prelude to the more detailed description that ispresented later.

Various electronic devices today typically can be operated by a userinteracting with a touch display screen of an electronic device. Thisfeature is particularly a characteristic of the recent generation ofsmart phones. A touch display screen can respond to finger contact toactivate the display to enable access to applications, functions, orfeatures of the electronic device and/or to enable further processes tobe performed. Contact may also be made with the touch display screenusing tools, such as a stylus, or other parts of the hand, such as thepalm and/or various parts of the finger. Smartphone manufacturerscontinuously develop new techniques to improve smartphone userexperience.

In accordance with a non-limiting, example implementation, a method cancomprise analyzing, by a system comprising a processor, characteristicsof touch screen data associated with a touch sensitive surface that isassociated with a device and motion data of at least one axis associatedwith the device. The method also can comprise, based at least in part onat least one result of the analyzing, determining, by the system, acontact classification for an object with respect to the touch sensitivesurface to facilitate determining a contact state of the object inrelation to the touch sensitive surface.

In accordance with another non-limiting, example implementation, asystem can comprise a memory that stores executable components, and aprocessor, operatively coupled to the memory, that executes theexecutable components. The executable components can include an objectclassification component configured to analyze touch surface informationassociated with a touch sensitive surface that is associated with adevice and motion information of at least one axis associated with thedevice, wherein the object classification component is furtherconfigured to determine a contact classification for an object withrespect to the touch sensitive surface, based at least in part on atleast one result of the analyzing, to facilitate determining a contactstate of the object with respect to the touch sensitive surface.

In accordance with still another non-limiting, example implementation, amachine-readable medium can comprise executable instructions that, whenexecuted by a processor, facilitate performance of operations. Theoperations can comprise examining characteristics of frame dataassociated with a touch sensitive surface that is associated with adevice and motion data associated with at least one axis that isassociated with the device. The operations also can include, based atleast in part on at least one result of the examining, determining acontact classification for an object with respect to the touch sensitivesurface to facilitate determining a contact state of the object withrespect to the touch sensitive surface.

The following description and the annexed drawings set forth certainillustrative aspects of the specification. These aspects are indicative,however, of but a few of the various ways in which the principles of thespecification may be employed. Other advantages and enhanced features ofthe specification will become apparent from the following detaileddescription of the specification when considered in conjunction with thedrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The patent or application file contains at least one drawing executed incolor. Copies of this patent or patent application publication withcolor drawings will be provided by the Office upon request and paymentof the necessary fee. Numerous aspects, implementations, objects, andadvantages of the disclosed subject matter will be apparent uponconsideration of the following detailed description, taken inconjunction with the accompanying drawings, in which like referencecharacters can refer to like parts throughout, and in which:

FIG. 1 illustrates a block diagram of an example touch sensitive devicethat can determine a classification of an object and a contact state ofthe object with respect to a touch sensitive surface of the touchsensitive device, in accordance with various aspects and embodiments ofthe disclosed subject matter;

FIG. 2 depicts a diagram of a top view of an example touch sensitivedevice, including a touch sensitive surface, in accordance with variousaspects and embodiments of the disclosed subject matter;

FIG. 3 presents a diagram of an example frame image as part of a visualrepresentation of a top view of an example touch sensitive device, theframe image comprising or representing frame data associated with thetouch sensitive surface, in accordance with various aspects andembodiments of the disclosed subject matter;

FIG. 4 depicts a diagram of an example frame image as part of a visualrepresentation of a top view of an example touch sensitive device,wherein the example frame image can include or represent frame datarelating to a contact with the touch sensitive surface, in accordancewith various aspects and embodiments of the disclosed subject matter;

FIG. 5 presents a diagram of an example frame image as part of a visualrepresentation of a top view of an example touch sensitive device,wherein the example frame image can comprise or represent frame datarelating to relative intensities of a contact with the touch sensitivesurface, in accordance with various aspects and embodiments of thedisclosed subject matter;

FIG. 6 illustrates a diagram of an example frame image as part of avisual representation of a top view of an example touch sensitivedevice, wherein the frame image can comprise or represent frame datathat can be captured or generated when certain surface-related sensorsof a sensor array detect relative intensities of contact of an ear of auser with the touch sensitive surface, in accordance with variousaspects and embodiments of the disclosed subject matter;

FIG. 7 presents a diagram of an example frame image that can begenerated based at least in part on capacitance data (e.g., mutualcapacitance data) when certain surface-related sensors of a sensor arraydetect relative intensities of contact of an ear of a user with thetouch sensitive surface, in accordance with various aspects andembodiments of the disclosed subject matter;

FIG. 8 illustrates a diagram of an example frame image that can begenerated based at least in part on capacitance data (e.g., mutualcapacitance data) when certain surface-related sensors of a sensor arraydetect relative intensities of contact of a finger of a user with thetouch sensitive surface, in accordance with various aspects andembodiments of the disclosed subject matter;

FIG. 9 depicts a diagram of an example graph that can represent motiondata relating to an ear of a user touching the touch sensitive surfacewhen certain sensors of the sensor component detect certain motion ofthe touch sensitive device, in accordance with various aspects andembodiments of the disclosed subject matter;

FIG. 10 illustrates a diagram of an example graph that can representmotion data relating to a finger of the user touching the touchsensitive surface when certain sensors of a sensor component detect aparticular motion of the touch sensitive device, in accordance withvarious aspects and embodiments of the disclosed subject matter;

FIG. 11 depicts a diagram of a top view of an example exterior view of atouch sensitive device, in accordance with various aspects andembodiments of the disclosed subject matter;

FIG. 12 illustrates a block diagram of an example touch sensitivedevice, in accordance with various aspects and embodiments of thedisclosed subject matter;

FIG. 13 illustrates a flow diagram of an example method for classifyingcontacts against or in proximity to a touch sensitive surface of a touchsensitive device, in accordance with various aspects and embodiments ofthe disclosed subject matter;

FIG. 14 depicts a diagram of an example frame image as part of a visualrepresentation of a top view of an example touch sensitive device,wherein the frame image can comprise or represent certain frame datarelating to an example sensing of an object in contact with a touchsensitive surface, in accordance with various aspects and embodiments ofthe disclosed subject matter;

FIG. 15 presents a diagram of an example frame image as part of a visualrepresentation of a top view of an example touch sensitive device,wherein the example frame image can comprise or represent certain framedata subdivided among non-uniform bounding areas, wherein the frame datarelates to an example sensing of an object in contact with a touchsensitive surface, in accordance with various aspects and embodiments ofthe disclosed subject matter;

FIG. 16 illustrates a diagram of an example frame image as part of avisual representation of a top view of a touch sensitive device, whereinthe example frame image can comprise or represent certain frame datasubdivided among non-uniform variously shaped bounding areas, whereinthe frame data relates to an example sensing of an object in contactwith a touch sensitive surface, in accordance with various aspects andembodiments of the disclosed subject matter;

FIG. 17 depicts a diagram of an example frame image as part of a visualrepresentation of a top view of an example touch sensitive device,wherein the example frame image can comprise or represent certain framedata associated with contact or association of an object with a touchsensitive surface, wherein the example frame image can be subdivided toform variously shaped bounding areas that can be determined based atleast in part on the frame data, in accordance with various aspects andembodiments of the disclosed subject matter;

FIG. 18 illustrates a diagram of an example scenario of a user having atouch sensitive device against the side of the user's head;

FIG. 19 illustrates a diagram of an example frame image as part of avisual representation of a top view of a touch sensitive device, whereinthe example frame image can comprise or represent frame data that can bedetermined during a time period when frame data for a frame is acquiredby a touch sensing system and an object classification component, inaccordance with various aspects and embodiments of the disclosed subjectmatter;

FIG. 20 presents a diagram of an example frame image as part of a visualrepresentation of a top view of a touch sensitive device, wherein theexample frame image can comprise or represent example frame data of anexample contact of an object with a touch sensitive surface, inaccordance with various aspects and embodiments of the disclosed subjectmatter;

FIG. 21 illustrates a flow diagram of another example method forclassifying contacts of objects with or in proximity to a touchsensitive surface of a touch sensitive device, in accordance withvarious aspects and embodiments of the disclosed subject matter;

FIG. 22 depicts a flow diagram of an example method for classifyingcontacts of objects with or in proximity to a touch sensitive surface ofa touch sensitive device based at least in part on touch surface dataassociated with the touch sensitive surface and motion data associatedwith the touch sensitive device, in accordance with various aspects andembodiments of the disclosed subject matter; and

FIG. 23 illustrates a flow diagram of another example method forclassifying contacts of objects with or in proximity to a touchsensitive surface of a touch sensitive device based at least in part ontouch surface data associated with the touch sensitive surface andmotion data associated with the touch sensitive device, in accordancewith various aspects and embodiments of the disclosed subject matter.

DETAILED DESCRIPTION

Various aspects of this disclosure are now described with reference tothe drawings, wherein like reference numerals are used to refer to likeelements throughout. In the following description, for purposes ofexplanation, numerous specific details are set forth in order to providea thorough understanding of one or more aspects. It should beunderstood, however, that certain aspects of this disclosure might bepracticed without these specific details, or with other methods,components, materials, etc. In other instances, well-known structuresand devices are shown in block diagram form to facilitate describing oneor more aspects.

In the following detailed description, references are made to theaccompanying drawings, which form a part of the description and in whichare shown, by way of illustration, specific embodiments. Although theseembodiments are described in sufficient detail to enable one skilled inthe art to practice the disclosure, it is understood that these examplesare not limiting, such that other embodiments may be used and changesmay be made without departing from the spirit and scope of thedisclosure.

One or more embodiments may be implemented in numerous ways, includingas a process, an apparatus, a system, a device, a method, a computerreadable medium such as a computer readable storage medium containingcomputer readable instructions or computer program code, or as acomputer program product comprising a computer usable medium having acomputer readable program code embodied therein.

The figures in the following description relate to preferred embodimentsby way of illustration only. The figures are not necessarily to scale.It should be noted that from the following discussion, alternativeembodiments of the structures and methods disclosed herein will bereadily recognized as viable alternatives that may be employed withoutdeparting from the principles of what is claimed.

Various electronic devices today typically can be operated by a userinteracting with a touch screen. This feature is particularly acharacteristic of the recent generation of smart phones. Typically,touch display screens can respond to finger contact to activate thetouch display screen for further processes. Contact also may be madewith the touch display screen using tools such as a stylus, other partsof the hand such as the palm and various parts of the finger.

A user may use an electronic device, such as a mobile phone (e.g., smartphone), with a touch display screen to make a phone call by placing thephone against the user's ear and/or part of the user's face, which cancause the user's ear and/or face to come in contact with the touchdisplay screen. This touching of the touch display screen by the user'sear and/or face may result in the touch display screen receiving touchinput from the user's ear and/or face, which can result in the touchdisplay screen unintentionally and undesirably being activated and/orthe mobile phone unintentionally and undesirably performing operationsbased on the input received by the touch display screen, even though theuser was not intending the interact with the touch display screen.

The disclosed subject matter can employ techniques that can enableimproved classification of objects associated with a touch sensitivesurface of a touch sensitive device. The disclosed subject matter cancomprise an object classification component that can analyze touchsurface data (e.g., touch surface or touch screen data) associated witha touch sensitive surface associated with a device and motion data ofone or more axes associated with the touch sensitive device. The objectclassification component can determine a contact classification for anobject(s) with respect to the touch sensitive surface, based at least inpart on at least one result of the analyzing, to facilitate determininga contact state of the object(s) with respect to the touch sensitivesurface. The disclosed subject matter also can comprise an eventdetermination component that can be associated with (e.g.,communicatively connected to) the object classification component. Theevent determination component can control functions associated with thetouch sensitive surface based at least in part on the contactclassification or the contact state of the object(s), wherein thefunctions can comprise, for example, enabling a touch sensitive functionof the touch sensitive surface of a display screen of the device,disabling the touch sensitive function of the touch sensitive surface ofthe display screen, switching the display screen on (e.g., to an onstate), and/or switching the display screen off (e.g., to an off state).

These and other aspects and embodiments of the disclosed subject matterare described with regard to the figures.

FIG. 1 illustrates a block diagram of an example touch sensitive device100 that can determine a classification of an object and a contact stateof the object with respect to a touch sensitive surface of the touchsensitive device, in accordance with various aspects and embodiments ofthe disclosed subject matter. The touch sensitive device 100 can be orcan comprise, for example, a mobile phone (e.g., a cellular phone and/orsmart phone), a computer, a display table, a personal digital assistant(PDA), an electronic tablet or notebook (e.g., a touch sensitive graphictablet or notebook), a web pad, an electronic gaming device, anelectronic workstation, a television, an Internet protocol (IP)television, a set-top box, a device (e.g., touch sensitive device) in orintegrated with a vehicle, a touch pad, a track pad, or other type ofdevice.

The touch sensitive device 100 can comprise a touch sensing system 102that can comprise or be associated with a touch sensitive surface 104that can sense when an object(s) (e.g., finger(s) of a user, ear of theuser, face of the user, or stylus) has been brought into contact withthe touch sensitive surface 104 or is in proximity to (e.g., is hoveringover and/or in proximity to) the touch sensitive surface 104. The touchsensitive surface 104 can have a size and shape that can be coextensivewith or can correspond to, or at least can be substantially coextensivewith or can substantially correspond to, the size and shape of apresentation area of a display screen of the touch sensitive device.

The touch sensitive device 100 also can include a sensor component 106that can comprise a set of sensors, wherein respective sensors of theset of sensors can sense respective conditions (e.g., contact or hoverconditions, motion conditions of the device 100, . . . ) of orassociated with the touch sensitive device 100. The set of sensors ofthe sensor component 106 can comprise surface-related sensors 108 thatcan be part of or associated with the touch sensing system 102 and thetouch sensitive surface 104. The surface-related sensors 108 can beconfigured to sense when an object(s) is in contact with the touchsensitive surface 104 or is in proximity to (e.g., is hovering overand/or in proximity to) the touch sensitive surface 104 and generatesensor data, such as touch surface data (e.g., touch surface or touchscreen data), relating to contact with or proximity to the touchsensitive surface 104 by the object(s), as more fully described herein.The sensor data can be employed to facilitate determining a contactclassification relating to a contact or an association (e.g., hover) ofan object(s) with respect to the touch sensitive surface 104 and/or acontact state of the object(s) in relation to the touch sensitivesurface 104, as more fully described herein.

The set of sensors of the sensor component 106 also can includemotion-related sensors 110 that can be configured to sense motionassociated with the touch sensitive device 100 and generate motion datarelating to the sensed motion associated with the touch sensitive device100, wherein the motion data can be employed to facilitate determining acontact classification relating to a contact or an association (e.g.,hover) of an object(s) with respect to the touch sensitive surface 104and/or a contact state of the object(s) in relation to the touchsensitive surface 104, as more fully described herein.

In some embodiments, the touch sensitive device 100 can comprise anobject classification component 112 that can analyze touch surface dataassociated with the touch sensitive surface 104 and the motion data ofat least one axis (e.g., one axis, two axes, three axes, . . . , sixaxes, . . . ) associated with the device 100, wherein the touch surfacedata can be received by the object classification component 112 from thesurface-related sensors 108), and the motion data can be received by theobject classification component 112 from the motion-related sensors 110.The object classification component 112 can determine a contactclassification or contact state for an object(s) with respect to thetouch sensitive surface 104, based at least in part on the results ofanalyzing the touch surface data and the motion data, as more fullydescribed herein.

The contact classifications that the object classification component 112can make can comprise, for example, a no touch state, a head state, afinger state, a head-hovering state, and a finger-hovering state. The notouch state can indicate that an object is not in contact with and isnot hovering in proximity to the touch sensitive surface 104. The headstate can indicate that the object(s) is a face, a head, or an ear of auser and such object(s) is in contact with the touch sensitive surface.The finger state can indicate that the object(s) is a finger(s) or ahand of the user and such object(s) is in contact with the touchsensitive surface. The head-hovering state can indicate that theobject(s) is the face, the head, or the ear of the user, and suchobject(s) is hovering over the touch sensitive surface 104 in proximityto the touch sensitive surface 104 and is not in contact with the touchsensitive surface 104. The finger-hovering state can indicate that theobject(s) is the finger(s) or the hand of the user, and such object(s)is hovering over the touch sensitive surface 104 in proximity to thetouch sensitive surface 104 and is not in contact with the touchsensitive surface 104. It is to be appreciated and understood that theobject classification component 112 also can make other types of contactclassifications for objects with respect to the touch sensitive surface104. For example, the object classification component 112 can furthercomprise contact classifications that can distinguish between a fingerof the user and a stylus and or can distinguish between a finger(s) anda hand of the user.

The touch sensitive device 100 further can comprise an eventdetermination component 114 that can be associated with (e.g.,communicatively connected to) the object classification component 112,the touch sensing system 102, the sensor component 106, a display screen(not shown in FIG. 1) of the touch sensitive device 100, and/or othercomponents of the touch sensitive device 100. As more fully describedherein, the event determination component 114 can control functionsassociated with the touch sensitive surface 104 based at least in parton (e.g., in response to) the contact classification or the contactstate of the object(s) with respect to the touch sensitive device 100,wherein the functions can comprise, for example, enabling a touchsensitive function of the touch sensitive surface 104 (e.g., of adisplay screen) of the touch sensitive device 100, disabling the touchsensitive function of the touch sensitive surface 104 (e.g., of thedisplay screen), switching (e.g., transitioning) the display screen(e.g., touch display screen) of the touch sensitive device 100 on (e.g.,to an on state), and/or switching the display screen off (e.g., to anoff state).

For example, in response to a determination that the contact state is ahead state (e.g., head or ear of a user) or a head-hovering state (e.g.,head or ear of the user in sufficiently close proximity to, but not inactual physical contact with, the touch sensitive surface 104), theevent determination component 114 can disable a touch sensitive functionof the touch sensitive surface 104 to reject the head contact or headhovering of the user such that the head contact or head hovering doesnot engage or select a touch sensitive function of the touch sensitivesurface 104 (e.g., does not enable selection of a button or controlassociated with the touch sensitive surface 104 as presented on thedisplay screen) and/or can control operation of the display screen(e.g., touch display screen) to have the display screen transition to orremain in an off state (e.g., a dark display screen). As anotherexample, in response to a determination that the contact state is afinger state (e.g., finger(s) of a user) or a finger-hovering state(e.g., finger(s) of the user in sufficiently close proximity to, but notin actual physical contact with, the touch sensitive surface 104), theevent determination component 114 can enable a touch sensitivefunction(s) of the touch sensitive surface 104 to allow the finger(s) ofthe user to engage or select the touch sensitive function(s) of thetouch sensitive surface 104 (e.g., enables selection of a button orcontrol associated with the touch sensitive surface 104 as presented onthe display screen) and/or can control operation of the display screento have the display screen transition to or remain in an on state (e.g.,a lit display screen).

With further regard to the touch sensitive surface 104, referring toFIG. 2 (along with FIG. 1), FIG. 2 depicts a diagram of the exampletouch sensitive device 100, including the touch sensitive surface 104,in accordance with various aspects and embodiments of the disclosedsubject matter. The touch sensitive surface 104 can comprise or beassociated with the surface-related sensors 108. In some embodiments,the surface-related sensors 108 can be distributed in various locationsassociated with the touch sensitive surface 104 to form a sensor array202, wherein respective surface-related sensors 108 can be associatedwith respective portions of the touch sensitive surface 104. Forexample, the surface-related sensors 108 can be distributed to invarious locations associated with the touch sensitive surface 104 toform a grid (e.g., an x, y grid). It is to be appreciated and understoodthat such a grid formation is merely one example formation that can beemployed for distributing the surface-related sensors 108 of the sensorarray 202 at various locations associated with the touch sensitivesurface 104, and, in accordance with other embodiments of the disclosedsubject matter, the surface-related sensors 108 can be distributed inother formations (e.g., uniform or non-uniform formations) with respectto the touch sensitive surface 104.

When an object(s) is brought into contact with, or is in sufficientlyclose proximity to, a location(s) on the touch sensitive surface 104,one or more surface-related sensors 108 of the sensor array 202 that areassociated with that location on the touch sensitive surface 104 cansense such contact of the object(s) with the that location(s) on thetouch sensitive surface 104 or sense such proximity of the object(s) tothat location(s) on the touch sensitive surface 104. In response to theone or more surface-related sensors 108 sensing or detecting theobject(s) in contact with or in proximity to that location(s) on thetouch sensitive surface 104, the one or more surface-related sensors 108can generate signals (e.g., sensor data) and can communicate the signalsto the object classification component 112 for analysis and evaluation(e.g., to facilitate determining which of the surface-related sensors108 is in contact with the object(s) or in proximity to the object(s)).

In some implementations, the touch sensing system 102 or objectclassification component 112 can sweep the surface-related sensors 108of the sensor array 202 or can otherwise poll the surface-relatedsensors 108 of the sensor array 202 to facilitate obtaining respectivesensor data (e.g., respective touch surface data) from respectivesurface-related sensors 108 of the sensor array 202, to facilitateenabling the object classification component 112 to determine whichportion(s) of the touch sensitive surface 104 is in contact with or inproximity to the object(s) at a given time (e.g., a given moment orperiod of time). For example, the touch sensing system 102 or objectclassification component 112 can sweep the surface-related sensors 108of the sensor array 202 or can otherwise poll the surface-relatedsensors 108 of the sensor array 202 every 1/30^(th) of a second, every1/60^(th) of a second, every 1/100^(th) of a second, or at anotherdesired rate or periodicity. The object classification component 112 (ortouch sensing system 102) can process and/or organize (e.g., arrange)the sensor data obtained from the surface-related sensors 108 of thesensor array 202 to generate frame data in the form of x, y dimensionaldata that can represent a respective contact states of respectivesurface-related sensors 108 at the given time, wherein respective framedata associated with the respective surface-related sensors 108 can beor can comprise the respective sensor data of the respectivesurface-related sensors 108 or the respective frame data can bedetermined based at least in part on the respective sensor data.

Frame data can be conceptually understood as providing an image or frameimage that can have higher-density portions representing areas of thetouch sensitive surface 104 that are in contact with (or in proximityto) an object(s) and other lower-density portions representing areas ofthe touch sensitive surface 104 that are not in contact with (or inproximity to) an object(s). Turning briefly to FIG. 3 (along with FIGS.1 and 2), FIG. 3 presents a diagram of an example frame image 300 aspart of a visual representation 350 of a top view of an example touchsensitive device 100, the frame image 300 comprising or representingframe data associated with the touch sensitive surface 104, inaccordance with various aspects and embodiments of the disclosed subjectmatter. With respect to the example frame image 300, the surface-relatedsensors 108 of the sensor array 202 have not detected an object incontact with or in proximity to the surface-related sensors 108 and havecorrespondingly generated signals (e.g., sensor data) indicating that noobject has been detected in contact with or in proximity to thesurface-related sensors 108. In this example frame image 300, as noobjects are detected in contact with or in proximity to the touchsensitive surface 104, the frame image 300 can have the appearanceillustrated in FIG. 3 with no higher-density portions (e.g., no darkercolored regions) being shown in the frame image 300.

However, when objects are brought into contact with or in proximity tothe touch sensitive surface 104, a portion of the surface-relatedsensors 108 of the sensor array 202 that are located in the portion(s)of the touch sensitive surface 104 that is in contact with or proximityto the objects can detect such objects, and can generate sensor datarepresenting such detection in response. The portion of thesurface-related sensors 108 can communicate the sensor data to reportthat the objects are in contact with or proximity to the portion(s) ofthe touch sensitive surface 104 associated with the portion of thesurface-related sensors 108. and a contrast pattern emerges in a frameimage representative of such a state.

Referring briefly to FIG. 4 (along with FIGS. 1 and 2), FIG. 4 depicts adiagram of an example frame image 400 as part of a visual representation450 of a top view of an example touch sensitive device 100, wherein theexample frame image 400 can include or represent frame data relating toa contact with the touch sensitive surface 104, in accordance withvarious aspects and embodiments of the disclosed subject matter. Theframe image 400 represents a frame associated with the touch sensitivesurface 104 at a time during which two fingers of a user are in contactwith (e.g., are pressed against) portions of the touch sensitive surface104.

In this example, the touch sensitive surface 104 has a sensor array 202of surface-related sensors 108 that can be read to indicate the binarystates of contact or no contact. In the event that a contact is madewith the touch sensitive surface 104, such contact either can besufficient to cross (e.g., exceed) a threshold for detection of contactby an object (e.g., finger) at each surface-related sensor 108 or it isnot sufficient to cross the threshold for detection of contact. In thisexample, a frame image, such as the example frame image 400, can beconceptually understood to include either an indication of contact or anindication of no contact and can include blobs 402 and 404 defined by apattern of full density areas where certain surface-related sensors 108of the sensor array 202 sense contact with another object(s) (e.g., twofingers of the user). For instance, in response to the two fingerscoming into contact with portions of the touch sensitive surface 104,the certain surface-related sensors 108, which are associated with thelocations of the portions of the touch sensitive surface 104, can sensethe contact with the objects (e.g., the two fingers of the user) and cangenerate sensor data indicating such contact with the objects. Theobject classification component 112 can receive the sensor data, and cananalyze the sensor data. Based at least in part on the results ofanalyzing the sensor data, the object classification component 112 candetermine and generate the frame image 400, which can includehigher-density portions (e.g., darker colored regions), as representedby the blobs 402 and 404, at locations of the frame image 400 that cancorrespond to the locations of the two fingers on the touch sensitivesurface 104, and lower-density portions (e.g., light or white coloredregions) at other locations of the frame image 400 that can correspondto the other locations on the touch sensitive surface 104 where nocontact with an object is indicated. While the example frame image 400relates to the issue of whether there is contact or no contact with thetouch sensitive surface 104 by an object, in accordance with variousother embodiments, the disclosed subject matter can sense, identify, anddistinguish between relative intensities of contact between an objectand a touch sensitive surface 104, and/or can sense, identify, anddistinguish between contact of an object with the touch sensitivesurface 104, hovering of an object in proximity to (without being incontact with) the touch sensitive surface 104, and no contact of anobject with or hovering of an object in proximity to the touch sensitivesurface 104, as more fully described herein.

For instance, in some implementations, the sensor array 202 ofsurface-related sensors 108 can be capable of detecting or determining alevel of intensity of contact of an object with the touch sensitivesurface 104, wherein the level of intensity of contact can relate to,for example an amount of pressure applied by an object on the touchsensitive surface 104, an intensity of a resistance experienced at thepoint of contact of the object with the touch sensitive surface 104, anintensity of a capacitance experienced at the point of contact of theobject with the touch sensitive surface 104, and/or another type(s) ofintensity relating to contact of an object with one or moresurface-related sensors 108 of the sensor array 202.

Turning briefly to FIG. 5 (along with FIGS. 1 and 2), FIG. 5 presents adiagram of an example frame image 500 as part of a visual representation550 of a top view of an example touch sensitive device 100, wherein theexample frame image 500 can comprise or represent frame data relating torelative intensities of a contact with the touch sensitive surface 104,in accordance with various aspects and embodiments of the disclosedsubject matter. The frame image 500 represents a frame associated withthe touch sensitive surface 104 at a time during which two fingers of auser are in contact with portions of the touch sensitive surface 104. Inthis example, the touch sensitive surface 104 can comprise a sensorarray 202 that can include surface-related sensors 108 that can be readto indicate no contact or relative states of intensity of contact withthe touch sensitive surface 104.

In the event that contact is made with the touch sensitive surface 104,the intensity of contact information presented in a frame image, such asthe example frame image 500, can be conceptually understood to bereflected in the frame image as grayscale image data, wherein blobs 502and 504 can represent the relative intensities of contact of two fingersof the user with respective portions of the touch sensitive surface 104,as the contact by the two fingers is sensed by certain surface-relatedsensors 108 of the sensor array 202. For instance, in response to thetwo fingers coming into contact with the portions of the touch sensitivesurface 104, the certain surface-related sensors 108, which can beassociated with the locations of the portions of the touch sensitivesurface 104, can sense the contact, including the relative intensitiesof contact, with the objects (e.g., the two fingers of the user) and cangenerate sensor data indicating such contact with the objects. Therespective surface-related sensors of the certain surface-relatedsensors 108 can generate respective sensor data that can indicate therespective and relative intensities of the contact of the objects (e.g.,the two fingers) with the portions of the touch sensitive surface 104.

The object classification component 112 can receive the respectivesensor data, and can analyze the respective sensor data. Based at leastin part on the results of analyzing the respective sensor data, theobject classification component 112 can determine and generate the frameimage 500, which can include respective and relative higher-densityportions (e.g., respective grayscale colored regions), as represented bythe respective grayscale information of the blobs 502 and 504, atlocations of the frame image 500 that can correspond to the locations ofthe two fingers on the touch sensitive surface 104, and lower-densityportions (e.g., light or white colored regions) at other locations ofthe frame image 400 that can correspond to the other locations on thetouch sensitive surface 104 where no contact with an object isindicated.

It is to be appreciated and understood that the objects that can comeinto contact with the touch sensitive surface 104 is not limited tofingers of the user. For example, mobile phones, PDAs, electronictablets, and electronic gaming devices also can be held against an earor face of a user at times so as to enable the user to better hear thesound produced by the device or to hear the sound produced by the devicemore confidentially, and/or to otherwise interact with the device. Thiscan create a variety of different contacts with the touch sensitivesurface 104.

Referring briefly to FIG. 6 (along with FIGS. 1 and 2), FIG. 6illustrates a diagram of an example frame image 600 as part of a visualrepresentation 650 of a top view of an example touch sensitive device100, wherein the frame image can comprise or represent frame data thatcan be captured or generated when certain surface-related sensors 108 ofthe sensor array 202 detect relative intensities of contact of an ear ofthe user with the touch sensitive surface 104, in accordance withvarious aspects and embodiments of the disclosed subject matter. Theframe image 600 represents a frame associated with the touch sensitivesurface 104 at a time during which the ear of the user is in contactwith portions of the touch sensitive surface 104. In this example, thetouch sensitive surface 104 can comprise or be associated with a sensorarray 202 that can include the surface-related sensors 108, which can beread to indicate no contact or relative states of intensity of contactwith the touch sensitive surface 104. Based at least in part on theresults of analyzing the respective sensor data from respectivesurface-related sensors of the certain surface-related sensors 108 thatindicate respective intensities of contact of the ear with respectiveportions of the touch sensitive surface 104, the object classificationcomponent 112 can generate the frame image 600 comprising the grayscalecolored region 602 that can present respective grayscale informationillustrating respective intensities of contact of the ear of the userwith the respective portions of the touch sensitive surface 104.

As can be observed from the example frame image 600, it may bechallenging for a touch sensitive device to determine whether this frameimage represents a pattern of one or more finger contacts with the touchsensitive surface or whether this pattern of contacts represents contactwith an ear or other physical features of the user. The accuracy andefficiency with which a touch sensitive device (e.g., touch sensitivedevice 100) can discriminate between such different types of contact canhave significant consequences on the use, activation, usability, andfunctionality of the device.

Turning briefly to FIG. 7 (along with FIGS. 1 and 2), FIG. 7 presents adiagram of an example frame image 700 that can be generated based atleast in part on capacitance data (e.g., mutual capacitance data) whencertain surface-related sensors 108 (e.g., capacitive sensors) of thesensor array 202 detect relative intensities of contact of an ear of theuser with the touch sensitive surface 104, in accordance with variousaspects and embodiments of the disclosed subject matter. The frame image700 represents a frame associated with the touch sensitive surface 104at a time during which the ear of the user is in contact with portionsof the touch sensitive surface 104. In this example, the touch sensitivesurface 104 can comprise or be associated with a sensor array 202 thatcan include the surface-related sensors 108, which can comprise certainsurface-related sensors 108, such as capacitive sensors, that can sensecapacitance levels associated with the touch sensitive surface 104. Thecertain surface-related sensors 108 (and/or other sensors 108) can senseno contact, relative states of intensity of contact with the touchsensitive surface 104, and/or relative proximity of an object (e.g.,ear, or portion of the ear, of the user) to the touch sensitive surface104 without touching the touch sensitive surface. As a result of thesensing, the certain surface-related sensors 108 (and/or other sensors108) can generate sensor data, such as capacitance data (e.g., mutualcapacitance data), that can correspond to the respective amounts ofcapacitance associated with respective portions of the touch sensitivesurface 104 and can indicate respective levels of contact (e.g., nocontact or respective states of intensity of contact) of an object(e.g., ear, or portion thereof, of the user) with the touch sensitivesurface 104 or respective proximity of the object, or portion thereof,to the touch sensitive surface 104.

The object classification component 112 can receive the sensor data fromthe certain surface-related sensors 108. Based at least in part on theresults of analyzing the respective sensor data (e.g., mutualcapacitance data) from respective surface-related sensors of the certainsurface-related sensors 108 that indicate respective intensities ofcontact of the ear with respective portions of the touch sensitivesurface 104 and/or respective proximity of the ear, or portion thereof,to the touch sensitive surface 104, the object classification component112 can generate the frame image 700 comprising the grayscale coloredregion 702 and grayscale colored region 704 that can present respectivegrayscale information (e.g., corresponding to respective higher-densityportions of the frame image 700) illustrating respective intensities ofcontact of respective portions of the ear of the user with therespective portions of the touch sensitive surface 104 and/or respectiveproximities of respective portions of the ear of the user to the touchsensitive surface 104. The grayscale colored region 702 can indicate theupper part of the user's ear is in contact with the portion of the touchsensitive surface 104 that can correspond to the location of thegrayscale colored region 702 depicted in the frame image 700. Thegrayscale colored region 704 can indicate the ear lobe of the user's earis in contact with (or at least in proximity to) another portion of thetouch sensitive surface 104 that can correspond to the location of thegrayscale colored region 704 depicted in the frame image 700. Forinstance, the portions 706 of the grayscale colored region 704 mayindicate that the portion (e.g., a portion of the ear lobe) of theuser's ear is in proximity to, but is not in physical contact with, thetouch sensitive surface 104.

Similar to the example frame image 600 of FIG. 6, as can be observedfrom the example frame image 700, it may be challenging for a touchsensitive device to determine whether the frame image 700 represents apattern of one or more finger contacts with the touch sensitive surfaceor whether this pattern of contacts represents contact with an ear orother physical features of the user. As disclosed, the accuracy andefficiency with which a touch sensitive device (e.g., touch sensitivedevice 100) can discriminate between such different types of contact canhave significant consequences on the use, activation, usability, andfunctionality of the device.

Referring briefly to FIG. 8 (along with FIGS. 1 and 2), FIG. 8illustrates a diagram of an example frame image 800 that can begenerated based at least in part on capacitance data (e.g., mutualcapacitance data) when certain surface-related sensors 108 (e.g.,capacitive sensors) of the sensor array 202 detect relative intensitiesof contact of a finger of a user with the touch sensitive surface 104,in accordance with various aspects and embodiments of the disclosedsubject matter. The frame image 800 represents a frame associated withthe touch sensitive surface 104 at a time during which a finger of auser is in contact with a portion of the touch sensitive surface 104. Inthis example, the touch sensitive surface 104 can comprise the sensorarray 202, which can include the surface-related sensors 108, which cancomprise certain surface-related sensors 108, such as capacitivesensors, that can sense capacitance levels associated with the touchsensitive surface 104. The certain surface-related sensors 108 (and/orother sensors 108) can sense no contact, relative states of intensity ofcontact with the touch sensitive surface 104, and/or relative proximityof an object (e.g., finger, or portion of the finger, of the user) tothe touch sensitive surface 104 without touching the touch sensitivesurface. As a result of the sensing, the certain surface-related sensors108 (and/or other sensors 108) can generate sensor data, such ascapacitance data (e.g., mutual capacitance data), that can correspond tothe respective amounts of capacitance associated with respectiveportions of the touch sensitive surface 104 and can indicate respectivelevels of contact (e.g., no contact or respective states of intensity ofcontact) of an object (e.g., finger, or portion of the finger, of theuser) with the touch sensitive surface 104 or respective proximity ofthe object, or portion thereof, to the touch sensitive surface 104.

The object classification component 112 can receive and analyze thesensor data from the certain surface-related sensors 108. Based at leastin part on the results of analyzing the respective sensor data (e.g.,mutual capacitance data) from respective surface-related sensors of thecertain surface-related sensors 108 that indicate respective intensitiesof contact of the ear with respective portions of the touch sensitivesurface 104 and/or respective proximity of the finger, or portionthereof, to the touch sensitive surface 104, the object classificationcomponent 112 can generate the frame image 800 comprising the grayscalecolored region 802 that can present respective grayscale information(e.g., corresponding to respective higher-density portions of the frameimage 800) illustrating respective intensities of contact of respectiveportions of the finger of the user with the respective portions of thetouch sensitive surface 104 (and/or at least respective proximities ofrespective portions of the finger of the user to the touch sensitivesurface 104). For instance, the grayscale colored region 804 canindicate that the user's finger is in contact with the portion of thetouch sensitive surface 104 that can correspond to the location of thegrayscale colored region 802 depicted in the frame image 800. As can beseen from the frame image 800, the contact of the user's finger with thetouch sensitive surface 104 can be strongest or hardest at a location ofthe touch sensitive surface 104 that can correspond to the location ofsubregion 806 (e.g., the darkest colored subregion) on the frame image800.

The ability to accurately discriminate between such different types ofcontact (e.g., ear (e.g., upper ear, ear lobe), finger(s), anotherobject(s)) can therefore one of the challenging aspects of the design oftouch sensitive devices. The disclosed subject matter can overcomedeficiencies of other techniques with regard to distinguishing betweendifferent types of contact with a touch sensitive surface, and canpresent touch sensitive devices and techniques (e.g., contactclassification techniques) that can provide improved and accuratediscrimination between and classification of different types of contactwith or proximity to a touch sensitive surface, including, for example,distinguishing between single-point finger contact, multi-point fingercontact, single-point head contact, multi-point head contact, and/orother types of contact (or proximity) of a body part of a user oranother type of object with (or to) a touch sensitive surface.

In some embodiments, the object classification component 112 canaccurately classify and discriminate between one or more contacts of oneor more objects with the touch sensitive surface 104 based at least inpart on the results of analyzing the pattern of contacts against or inproximity to the touch sensitive surface 104. For instance, the objectclassification component 112 can analyze a frame image using patternrecognition tools and techniques to determine whether thetwo-dimensional image provided by touch sensitive surface 104 has anappearance associated with a particular type of contact. For example,palm touch contacts with the touch sensitive surface may appear asrelatively large irregular blobs, while fingers in contact with thetouch sensitive surface can tend to appear as relatively smallerellipsoids. The object classification component 112 can recognize anduse the differences in shape and size of such different types of contactwith the touch sensitive surface 104 to distinguish between andrespectively identify palm touch contacts and finger touch contactswith, or proximity of a palm or finger(s) to, the touch sensitivesurface 104 (e.g., through use of various classification techniques,such as machine learning), as more fully described herein.

In accordance with various embodiments, the object classificationcomponent 112 can accurately classify and discriminate between one ormore contacts of (or proximity of) one or more objects with (or to) thetouch sensitive surface 104, and can determine a contact classificationof the one or more objects with respect to the touch sensitive surface104, based at least in part on the results of analyzing touch surfacedata (e.g., surface-related sensor data) associated with the touchsensitive surface 104 (e.g., the pattern of contacts against (or inproximity to) the touch sensitive surface 104) and motion data relatingto motion of the touch sensitive device 100, in accordance with definedclassification criteria, as more fully described herein. The contactclassifications that the object classification component 112 can makecan comprise, for example, a no touch state, a head state, a fingerstate, a head-hovering state, a finger-hovering state, and/or one ormore other types of contact classifications, as more fully describedherein.

In some embodiments, the sensor component 106 can comprise one or moremotion-related sensors 110 that can be employed to detect motion of thetouch sensitive device 100 about or along one or more axes (e.g.,x-axis, y-axis, and/or z-axis) and can generate sensor data (e.g.,motion-related sensor data) that can correspond to the motion of thetouch sensitive device 100 detected by the one or more motion-relatedsensors 110. For example, a multi-axis (e.g., two or three axis)motion-related sensor can generate first motion data relating to motionof the touch sensitive device along a first axis (e.g., x-axis), secondmotion data relating to motion of the touch sensitive device along asecond axis (e.g., y-axis), and/or third motion data relating to motionof the touch sensitive device along a third axis (e.g., z-axis).

The one or more motion-related sensors 110 can comprise, for example,one or more of an accelerometer(s), a gyroscope(s), an inertialmeasurement unit (IMU), and/or another type(s) of motion-related sensor.Respective motion-related sensors 110 (e.g., accelerometer, gyroscope,IMU, and/or other type of motion-related sensor) can be single-axismotion-related sensors or multiple-axis (e.g., two-axis or three-axis)motion related sensors. The one or more motion-related sensors 110 canmonitor and sense motion of the touch sensitive device 100 at a desiredsensing rate (e.g., a second or sub-second rate). For example, amotion-related sensor 110 can monitor and sense motion of the touchsensitive device 100 along one or more axes every 1/30^(th) of a second,every 1/60^(th) of a second, every 1/100^(th) of a second, or at anotherdesired sensing rate. In certain embodiments, the motion-related sensors110 can include one or more vibro-acoustic sensors that can detectand/or measure movement or vibrations of the touch sensitive device 100.The one or more vibro-acoustic sensors can generate motion data,comprising vibro-acoustic data, based at least in part on the detectedor measured movement or vibrations of the touch sensitive device 100,and can provide such motion data to the object classification component112 for analysis.

In some embodiments, as motion data is generated by the motion-relatedsensors 110, that motion data can be stored in a buffer component 116(e.g., buffer memory) for a desired amount of time. For instance, thebuffer component 116 can store motion data (and/or touch surface data)that can cover a defined period of time (e.g., the last second, the lasttwo seconds, the last three seconds, or another desired period of time).As an example, in response to determining that the touch sensitivedevice 100 is in an in-call state, the object classification component112 (or another component, such as a processor, of the touch sensitivedevice) can have the buffer component 116 store the motion data, thetouch surface data, or other desired data (e.g., orientation data, touchdata, . . . ) to facilitate analysis of such data by the objectclassification component 112.

With regard to employing touch surface data and motion data to classifycontact or association with the touch sensitive surface 104, the objectclassification component 112 can analyze touch surface data (e.g.,surface-related sensor data) received from the surface-related sensors108. In some embodiments, as part of the analysis, the objectclassification component 112 can identify and extract features relatedto contact or association (e.g., hovering) of an object(s) with thetouch sensitive surface 104 from the touch surface data. The featurescan comprise, for example, characteristics, shapes, dimensions, spectralcentroid, spectral density, spherical harmonics, total average spectralenergy, and/or log spectral band ratios related to the contact orassociation of the object(s) with the touch sensitive surface 104, withrespect to the time domain or frequency domain, respectively. The objectclassification component 112 can utilize the features (e.g., extractedfeatures) to generate a frame image, comprising frame data, of thecontact or association of the object(s) with the touch sensitive surface104. In other embodiments, the object classification component 112 cananalyze the touch surface data without extracting features relating tocontact or association (e.g., hovering) of the object(s) with the touchsensitive surface 104 from the touch surface data.

Based at least in part on the results of analyzing such touch surfacedata, the object classification component 112 can determine at least aninitial classification (e.g., initial contact classification) of thecontact of an object(s) with the touch sensitive surface 104 inaccordance with the defined classification criteria, as more fullydescribed herein. For instance, based at least in part on the results ofanalyzing the touch surface data, the object classification component112 can determine that the touch surface data is indicative of aparticular contact classification and/or a particular contact state ofan object(s) with the touch sensitive surface 104. The objectclassification component 112 can perform such determination regardingcontact classification and/or contact state based at least in part onthe results of analyzing the raw touch surface data (without extractingfeatures from the touch surface data) or based at least in part on theresults of analyzing the features extracted from the touch surface data.

The object classification component 112 also can analyze other sensordata, such as motion data (e.g., motion-related sensor data) receivedfrom the motion-related sensors 110. In connection with performing theanalysis, the object classification component 112 can retrieve themotion data that is stored in the buffer component 116, wherein suchmotion data can cover a defined period of time. In some embodiments, aspart of the analysis, the object classification component 112 canidentify and extract features related to contact or association (e.g.,hovering) of an object(s) with the touch sensitive surface 104 from themotion data. The object classification component 112 can utilize thefeatures (e.g., extracted features) to generate a frame image,comprising frame data, of the contact or association of the object(s)with the touch sensitive surface 104. In certain embodiments, the objectclassification component 112 can perform an integrated analysis of thetouch surface data and the motion data, wherein the objectclassification component 112 can generate a frame image, comprisingframe data, of the contact or association of the object(s) with thetouch sensitive surface 104 based at least in part on the featuresextracted from the touch surface data and the motion data as part of theanalysis. In other embodiments, the object classification component 112can analyze the motion data (and the touch surface data) withoutextracting features relating to contact or association (e.g., hovering)of the object(s) with the touch sensitive surface 104 from the motiondata (or the touch surface data).

The object classification component 112 can determine a classificationof the contact or association (e.g., hovering) of an object(s) with thetouch sensitive surface 104 based at least in part on the results ofanalyzing the motion data, in accordance with the defined classificationcriteria, as more fully described herein. For example, based at least inpart on the results of analyzing the motion data, the objectclassification component 112 can determine that the motion data isindicative of the particular contact classification and/or theparticular contact state of an object(s) with the touch sensitivesurface 104 (or, in some instances, may be indicative of a differentcontact classification or different contact state from that determinedbased on the touch surface data).

In some implementations, the analysis of the motion data by the objectclassification component 112 can be used by the object classificationcomponent 112 to facilitate verifying or confirming the initial contactclassification derived from the analysis of the touch surface data(e.g., surface-related sensor data). For example, if the initial contactclassification based on the touch surface data is that there is contactby an object(s) with the touch sensitive surface 104, and such contactor association is a finger of the user, and if the analysis of themotion data indicates that there is a finger in contact with the touchsensitive surface 104, the object classification component 112 candetermine that the motion data analysis confirms the initial contactclassification, and can determine that the contact state associated withthe touch sensitive surface 104 is a finger touch of the touch sensitivesurface. If, however, the initial contact classification based on thetouch surface data is that there is contact with the touch sensitivesurface 104, and such contact is two fingers of the user, and if theanalysis of the motion data indicates that an ear of the user is incontact with the touch sensitive surface 104, the object classificationcomponent 112 can determine that the motion data analysis does notconfirm the initial contact classification determined using the touchsurface data, and can determine that no contact classification orcontact state can be determined based on such sensor data, and/or candetermine that other types of sensor data are to be analyzed, and/or candetermine that additional touch surface data and/or motion data are tobe collected and analyzed, to facilitate determining a contactclassification and contact state associated with the touch sensitivesurface 104.

In other implementations, if the initial contact classification attemptbased on the touch surface data was inconclusive or ambiguous, theanalysis of the motion data by the object classification component 112can be used by the object classification component 112 to facilitatedetermining a classification of the contact or association of anobject(s) with the touch sensitive surface 104, in accordance with thedefined classification criteria. In still other implementations, theobject classification component 112 can determine a classification ofthe contact or association of an object(s) with respect to the touchsensitive surface 104 and the contact state associated with the touchsensitive surface 104 based on the results of analyzing the motion data,without having to analyze touch surface data or other types of sensordata, in accordance with the defined classification criteria.

In some embodiments, the object classification component 112 cancomprise a classification engine (e.g., trained classification engine)that can identify and/or distinguish between different types of contactor association (e.g., hovering) with the touch sensitive surface 104based at least in part on the results of analyzing touch surface dataand/or the motion data relating to motion of the touch sensitive device100. The classification engine of the object classification component112 can be trained by applying positive examples of touch surface datarelating to finger(s) contacts (e.g., single-point finger contacts,multi-point finger contacts) or associations (e.g., hovering finger(s))with the touch sensitive surface 104 and positive examples of touchsurface data relating to ear and/or facial contacts (e.g., upper earcontacts, ear lobe contacts, cheek contacts, . . . ) or associationswith the touch sensitive surface 104 to the classification engine totrain the classification engine to identify and distinguish betweenvarious different types of contacts or associations with the touchsensitive surface 104. The positive examples of touch surface data cancomprise, for example, positive examples of patterns of contact orassociation relating to finger(s) contacts or associations with thetouch sensitive surface 104 and positive examples of patterns of contactor association relating to ear and/or facial contacts with the touchsensitive surface 104.

The classification engine of the object classification component 112also can be trained by applying positive examples of motion datarelating to finger(s) contacts (e.g., single-point finger contacts,multi-point finger contacts) or associations (e.g., hovering) with thetouch sensitive surface 104 and positive examples of motion datarelating to ear and/or facial contacts (e.g., upper ear contacts, earlobe contacts, cheek contacts, . . . ) or associations with the touchsensitive surface 104 to the classification engine to train theclassification engine to identify and distinguish between variousdifferent types of contacts or associations with the touch sensitivesurface 104. The positive examples of motion data can comprise, forexample, positive examples of patterns of motion of the touch sensitivedevice 100 relating to finger(s) contacts or associations with the touchsensitive surface 104 and positive examples of patterns of motion of thetouch sensitive device 100 relating to ear and/or facial contacts orassociations with the touch sensitive surface 104.

The classification engine can be updated and refined over time toenhance classifications of contacts or associations of objects with thetouch sensitive surface 104. For example, the object classificationcomponent 112 can receive updates relating to contact classification toapply to the classification engine to refine and enhance classificationsof contacts or associations of objects with the touch sensitive surface104 by the classification engine. In some embodiments, during operationof the touch sensitive device 100, the object classification component112 can train, update, refine, and/or enhance the classification engineto refine and enhance classifications of contacts or associations ofobjects with the touch sensitive surface 104 by the classificationengine.

Turning briefly to FIG. 9 (along with FIG. 1), FIG. 9 depicts a diagramof an example graph 900 that can represent motion data relating to anear of the user touching the touch sensitive surface 104 when certainsensors (e.g., motion-related sensors 110) of the sensor component 106detect certain motion of the touch sensitive device 100, in accordancewith various aspects and embodiments of the disclosed subject matter.The motion data presented in the example graph 900 can compriserespective motion data along six respective axes associated with thetouch sensitive device 100 for a defined period of time (e.g., 2.5seconds or other desired amount of time that can be less than or greaterthan 2.5 seconds), as such respective motion data was obtained by athree-axis accelerometer and a three-axis gyroscope and stored in thebuffer component 116. For instance, the motion data can comprise firstaccelerometer data 902 along a first axis, second accelerometer data 904along a second axis, and third accelerometer data 906 along a thirdaxis, of the accelerometer; and the motion data also can comprise firstgyroscope data 908 along a first axis, second gyroscope data 910 along asecond axis, and third gyroscope data 912 along a third axis, of thegyroscope.

The object classification component 112, employing the classificationengine, can analyze the motion data (e.g., motion data presented inexample graph 900). Based at least in part on the results of theanalysis of the motion data, the object classification component 112 candetermine that there is contact of an object with the touch sensitivesurface 104 and that the object is an ear of the user, or at least candetermine that the motion data analysis results are indicative of theear of the user being in contact with the touch sensitive surface 104.

Referring briefly to FIG. 10 (along with FIGS. 1 and 9), FIG. 10illustrates a diagram of an example graph 1000 that can represent motiondata relating to a finger of the user touching the touch sensitivesurface 104 when certain sensors (e.g., motion-related sensors 110) ofthe sensor component 106 detect a particular motion of the touchsensitive device 100, in accordance with various aspects and embodimentsof the disclosed subject matter. The motion data presented in theexample graph 1000 can comprise respective motion data along sixrespective axes associated with the touch sensitive device 100 for adefined period of time (e.g., 2.5 seconds), as such respective motiondata was obtained by a three-axis accelerometer and a three-axisgyroscope and stored in the buffer component 116. In the example graph1000, the motion data can comprise first accelerometer data 1002 along afirst axis, second accelerometer data 1004 along a second axis, andthird accelerometer data 1006 along a third axis, of the accelerometer;and the motion data also can comprise first gyroscope data 1008 along afirst axis, second gyroscope data 1010 along a second axis, and thirdgyroscope data 1012 along a third axis, of the gyroscope.

The object classification component 112, employing the classificationengine, can analyze the motion data (e.g., motion data presented inexample graph 1000). Based at least in part on the results of theanalysis of such motion data, the object classification component 112can determine that there is contact of an object with the touchsensitive surface 104 and that the object is a finger of the user, or atleast can determine that the motion data analysis results are indicativeof the finger of the user being in contact with the touch sensitivesurface 104.

As can readily be ascertained when observing the motion data relating toear contact, as presented in example graph 900, and the motion datarelating to finger contact, as presented in example graph 1000, themotion data relating to an ear contact with the touch sensitive surface104 can be significantly different than the motion data relating to afinger contact with the touch sensitive surface 104. It is to beappreciated and understood that, even in instances where motion datarelating to ear contact and motion data relating to finger contact wouldappear (e.g., to a user) to be relatively similar (e.g., in a graph),the object classification component 112 (e.g., employing theclassification engine) can be sufficiently trained to identify anddistinguish between instances of ear contact (or association) with thetouch sensitive surface 104 and instances of finger contact (orassociation) with the touch sensitive surface 104. It also is to beappreciated and understood that motion data can indicate that there isno contact or association (e.g., no hovering) with the touch sensitivesurface 104 or can indicate that a different type of contact with thetouch sensitive surface 104, other than a finger or ear (or face), hasoccurred, and the object classification component 112 (e.g., employingthe classification engine) can identify and distinguish betweeninstances of no contact or association with the touch sensitive surface104, finger contact or association with the touch sensitive surface 104,ear (or face) contact or association with the touch sensitive surface104, or a different type of contact or association with the touchsensitive surface 104, in accordance with the defined classificationcriteria.

As disclosed herein, the object classification component 112 can utilizeone or more axes of motion data to facilitate determining contactclassifications of an object(s) with respect to the touch sensitivesurface. The number of axes of motion data utilized by the objectclassification component 112 can be determined based at least in part ona number of factors, in accordance with the defined classificationcriteria. The factors can comprise, for example, the type(s) and/ornumber of motion-related sensors 110 employed by the touch sensitivedevice 100, the amount of resources and/or time available to the objectclassification component for a contact classification at the time theanalysis of motion data (and/or other data (e.g., touch surface data))is being performed, a confidence level of a contact classification madeusing the touch surface data (and/or other sensor data), and/or one ormore other factors.

For example, if a touch sensitive device employs a single-axisaccelerometer and no other type of motion-related sensor, only one axisof motion data can be available for analysis by the objectclassification component; if a touch sensitive device employs a two-axisaccelerometer and no other type of motion-related sensor, only up to twoaxes of motion data can be available for analysis by the objectclassification component 12; and if a touch sensitive device employs athree-axis accelerometer and no other type of motion-related sensor,only up to three axes of motion data can be available for analysis bythe object classification component. As another example, if a touchsensitive device employs a three-axis accelerometer and a three-axisgyroscope, up to six axes of motion data can be available for analysisby the object classification component, whereas if only a three-axisaccelerometer is used and no three-axis gyroscope is employed (oralternatively if only a three-axis gyroscope is used and no three-axisaccelerometer is employed), only up to three axes of motion data can beavailable for analysis by the object classification component.

With regard to resources and time available to the object classificationcomponent 112 for classification, when analyzing data, such as touchsurface data and motion data associated with the touch sensitive device100, there may be some instances where the amount of available resources(e.g., processing resources) and/or time is relatively lower. In suchinstances, even if the object classification component 112 has motiondata associated with a higher number (e.g., six, five, or four, . . . )of axes available for analysis, given the relatively lower amount ofresources or time available at that particular time, when desirable(e.g., when in accordance with the applicable defined classificationcriteria), the object classification component 112 can utilize andanalyze motion data associated with a lower number (e.g., one, two,three, . . . ) of axes (or axis) in determining a contact classificationof an object(s) with respect to the touch sensitive surface 104. Ininstances when there are sufficient resources and time available, theobject classification component 112 can use and analyze all or a desiredportion motion data associated with all or a desired number of availableaxes to determine a contact classification of an object(s) with respectto the touch sensitive surface 104, in accordance with the definedclassification criteria.

With regard to confidence level as a factor, in some implementations,the object classification component 112 can perform an analysis (or arelatively quicker preliminary analysis) on the touch surface data todetermine an initial contact classification (or preliminary contactclassification) for an object(s) with respect to the touch sensitivesurface 104, wherein, as part of the analysis, the object classificationcomponent 112 also can determine a confidence level in the accuracy ofthe initial (or preliminary) contact classification. Based at least inpart on the confidence level in the accuracy of the initial (orpreliminary) contact classification, the object classification component112 can determine the amount of motion data (e.g., the number of axes ofmotion data) to analyze to determine (e.g., make a final determinationof) a contact classification for an object(s) with respect to the touchsensitive surface 104, in accordance with the defined classificationcriteria (e.g., criteria relating to confidence levels in accuracy ofcontact classifications and/or resources and time).

For example, if the object classification component 112 determines thatthe confidence level in the accuracy of the initial (or preliminary)contact classification is relatively high (e.g., satisfies (e.g., meetsor exceeds) a defined threshold confidence level in accuracy), theobject classification component 112 can determine that a relativelylower amount of motion data (e.g., a lower number of axes of motiondata) is to be analyzed to determine, verify, or confirm a contactclassification for the object(s) with respect to the touch sensitivesurface 104, in accordance with the defined classification criteria. Inthis way, the object classification component 112 can determine thecontact classification for the object(s) with respect to the touchsensitive surface 104 with a desirably (e.g., sufficiently or suitably)high level of confidence in the accuracy of such contact classificationwithout undesirably (e.g., unnecessarily) utilizing the additionalresources and time to analyze all or a larger portion of the availablemotion data (e.g., all or a larger number of axes of motion data) inconnection with determining such contact classification.

If, however, the object classification component 112 determines that theconfidence level in the accuracy of the initial (or preliminary) contactclassification is relatively low (e.g., does not satisfy (e.g., does notmeet or exceed) the defined threshold confidence level in accuracy), theobject classification component 112 can determine that a relativelyhigher amount of motion data (e.g., all or a relatively higher number ofaxes of motion data) is to be analyzed to determine, verify, or confirma contact classification for the object(s) with respect to the touchsensitive surface 104, in accordance with the defined classificationcriteria. In this way, the object classification component 112 cananalyze all or at least a relatively higher amount of the availablemotion data to attempt to determine or verify a contact classificationfor the object(s) with respect to the touch sensitive surface 104 to ahigher level of confidence in the accuracy of the contact classificationthan the accuracy confidence level achieved through analysis of thetouch surface data alone.

It is to be appreciated and understood that typically, or at least it ismore likely that, the performance and determination of contactclassification for an object(s) with respect to the touch sensitivesurface 104 by the object classification component 112 can be desirablyenhanced (e.g., increasingly improved and/or more accurate) by usingmotion data associated with a higher number of axes than by using motiondata associated with a lower number of axes or not using motion data atall.

In accordance with various other embodiments, additionally oralternatively, the object classification component 112 can utilize otherinformation (e.g., supplemental information) to facilitate classifyingand discriminating between one or more contacts of one or more objectswith the touch sensitive surface 104, as more fully described herein.For example, the object classification component 112 (or anothercomponent of the touch sensitive device 100) can monitor and analyzevibro-acoustic data relating to movement or vibrations associated withthe touch sensitive device 100, wherein the vibro-acoustic data canprovide information that can facilitate classifying and distinguishing(e.g., disambiguating) between the types of contact that objects canhave with the touch sensitive surface 104 of the touch sensitive device100. For example, one or more sensors of the sensor component 106 cansense vibrations of the device 100 or associated with the device 100,and can generate vibro-acoustic data based at least in part on suchsensing. The object classification component 112 can use (e.g., analyze)the vibro-acoustic data to facilitate identifying when the touchsensitive surface 104 has been brought into contact with fingertips of auser, finger knuckles of the user, fingernails of the user, an ear ofthe user, a portion of a face of the user, a stylus, and/or a widevariety of other types of things.

Additionally or alternatively, the object classification component 112can utilize orientation data relating to the orientation of the touchsensitive device 100 to facilitate determining a contact classificationfor an object(s) with respect to the touch sensitive surface 104. Forinstance, the sensor component 106 can comprise one or more sensors(e.g., motion-related sensors 110, such as an accelerometer, agyroscope, and/or an IMU) that can sense, measure, determine, and/orfacilitate determining an orientation of the touch sensitive device 100with respect to the environment. The one or more sensors can providesensor data (e.g., orientation data) relating to the orientation of thetouch sensitive device 100 to the object classification component 112.Certain orientations of the touch sensitive device 100 and correspondingorientation data can be generally or at least often consistent withand/or can indicate that an object(s) associated with (e.g., in contactwith or hovering in proximity to) the touch sensitive surface 104 is afinger(s) of a user. Other orientations of the touch sensitive device100 and corresponding orientation data can be generally or at leastoften consistent with and/or can indicate that an object(s) associatedwith the touch sensitive surface 104 is an ear or portion (e.g., cheek)of a face of the user. The object classification component 112 canutilize the orientation data to facilitate identifying anddistinguishing between different types of contact or other association(e.g., hover) with the touch sensitive surface 104.

The object classification component 112 can analyze the orientation dataand other sensor data, such as touch surface data and/or motion data(and/or other sensor data). Based at least in part on the results ofanalyzing the orientation data, touch surface data, and/or motion data(and/or other sensor data), the object classification component 112 candetermine a contact classification or contact state of an object(s) withrespect to the touch sensitive surface 104, in accordance with thedefined classification criteria.

Additionally or alternatively, visible light sensors and/or infraredsensors also can be included in devices (e.g., digital display devices)to detect when the head, finger, or other part of a user is positionedin close proximity to the touch sensitive surface (e.g., touch screensurface) of such device. The object classification component 112 can useand analyze sensor data produced by the visible light sensors and/orinfrared sensors to facilitate discriminating between finger contact,head contact, or other contact between a part of the user and the touchsensitive surface 104 of such device 100. It is to be appreciated andunderstood that the object classification component 112 can accuratelyclassify and discriminate between one or more contacts or associations(e.g., hover) of one or more objects with the touch sensitive surface104 (e.g., accurately classify and discriminate between multi-pointcontacts) of the touch sensitive device 100 without the touch sensitivedevice 100 using or relying on using, for example, visible light sensorsand/or infrared sensors.

The contact classification or state for an object(s) with respect to thetouch sensitive surface 104 can be utilized to facilitate makingdecisions regarding the controlling of various functions of the touchsensitive surface 104 or other components of the touch sensitive device100. The event determination component 114 can be employed to facilitatecontrolling functions of the touch sensitive surface 104 and/or othercomponents of the touch sensitive device 100.

The event determination component 114 can receive, from the objectclassification component 112, information regarding the contactclassification and/or contact state of an object(s), if any, withrespect to the touch sensitive surface 104. The event determinationcomponent 114 can analyze the information regarding the contactclassification and/or contact state of the object(s) with respect to thetouch sensitive surface 104.

Based at least in part on the results of analyzing the informationrelating to the contact classification or the contact state of theobject(s) with respect to the touch sensitive surface 104, the eventdetermination component 114 can control functions associated with thetouch sensitive surface 104 and/or other components of the touchsensitive device 100, in accordance with the defined classificationcriteria. The functions can comprise, for example, enabling a touchsensitive function of the touch sensitive surface 104 (e.g., of adisplay screen) of the touch sensitive device 100, disabling the touchsensitive function of the touch sensitive surface 104 (e.g., of thedisplay screen), switching the display screen (e.g., touch displayscreen) of the touch sensitive device 100 on (e.g., to an on state),and/or switching the display screen off (e.g., to an off state).

For example, in response to determining that the contact classificationor state (e.g., finger state or finger-hovering state) is that theobject is a finger in contact with or hovering in proximity to the touchsensitive surface 104, the event determination component 114 candetermining that touch functions associated with the touch sensitivesurface 104 are to be enabled to allow the user to manipulate controls(e.g., buttons on touch display screen, keys of a touch screen keyboardor keypad on the touch display screen, . . . ) presented on the touchsensitive surface 104 and/or can switch (or maintain) the display screenof the touch sensitive surface 104 in an on state. As another example,in response to determining that the contact classification or state(e.g., head or ear state or head-hovering state) is that the object(s)is a portion of the user's head (e.g., ear and/or cheek) in contact withor hovering in proximity to the touch sensitive surface 104, the eventdetermination component 114 can determining that touch functionsassociated with the touch sensitive surface 104 are to be disabled toprevent the user from manipulating (e.g., inadvertently manipulatingcontrols (e.g., buttons, keys, . . . ) presented on the touch sensitivesurface 104 and/or can switch (or maintain) the display screen of thetouch sensitive surface 104 in an off state (e.g., to reduce powerconsumption).

FIG. 11 depicts a diagram of a top view of an example exterior view of atouch sensitive device 1100, and FIG. 12 illustrates a block diagram ofthe example touch sensitive device 1100, in accordance with variousaspects and embodiments of the disclosed subject matter. The touchsensitive device 1100 can comprise the touch sensing system 102 and thetouch sensitive surface 104, which can be associated with the touchsensing system 102. The touch sensitive device 1100 also can include thesensor component 106, which can comprise various sensors, including thesurface-related sensors 108 and the motion-related sensors 110. Thetouch sensitive device 1100 further can comprise the objectclassification component 112 and the event determination component 114.The touch sensitive device 1100 also can include the buffer component116, which can store (e.g., temporarily store) motion data, touchsurface data, pattern data, and/or other data, as more fully describedherein.

The touch sensitive device 1100 can comprise a display system 1102 thatcan include a display screen 1104 (e.g., touch display screen) that canpresent visual information, such as visual images, over a presentationarea 1106 (e.g., a two-dimensional or three-dimensional presentationarea). The touch sensing system 102 can include and/or provide the touchsensitive surface 104, which, at least in part, can be coextensive orcan correspond to, or at least can be substantially coextensive or cansubstantially correspond to, the presentation area 1106.

The touch sensitive surface 104 can be adapted to detect (e.g., via thesurface-related sensors 108) when an object(s) (e.g., a fingertip(s), anear, a face, a stylus), such as an object 1108, is positioned in contactwith or in proximity to, the touch sensitive surface 104, wherein thesurface-related sensors 108 can generate respective signals (e.g.,sensor data) from which the object classification component 112 candetermine or facilitate determining a classification of the relationshipof the object(s) (e.g., object 1108) with respect to the touch sensitivesurface 104 (e.g., can determine which portion(s) of the touch sensitivesurface 104 is in contact or in proximity to the object(s) 1108).

The touch sensitive device 1100 can take various forms including but notlimited to any type of digital equipment comprising a touch sensingsystem 102 and a processor 1110, such as a micro-processor,micro-controller, or any other type of programmable control device, or apreprogrammed or dedicated processing or control system. In accordancewith various embodiments, the touch sensitive device 1100 can be or cancomprise, for example, a mobile phone (e.g., a cellular phone and/orsmart phone), a computer, a display table, a personal digital assistant(PDA), an electronic tablet or notebook (e.g., a touch sensitive graphictablet or notebook), a web pad, an electronic gaming device, anelectronic workstation, a television, an Internet protocol (IP)television, a set-top box, a device (e.g., touch sensitive device) in orintegrated with a vehicle, a touch pad, a track pad, or other type ofdevice. In this regard, it will be appreciated and understood that,while the components of the touch sensitive device 1100 are illustratedin FIGS. 11 and 12 as being within a single housing 1112, this can beoptional, and, in accordance with various embodiments, one or more ofthe various components of touch sensitive device 1100 can be located inseparately housed components of the touch sensitive device 1100.

The touch sensitive surface 104 of the touch sensing system 102 cansense when an object(s) 1108 touches or is in proximity to (e.g., closeenough proximity to) the touch sensitive surface 104. For instance, thetouch sensitive surface can comprise or be associated with an array ofsensors (e.g., an array of surface-related sensors 108) that can sensewhen an object is in contact with or proximity to the touch sensitivesurface 104. The sensors of the touch sensing system 102 can generatesignals (e.g., sensor data, such as touch surface data) from which itcan be determined (e.g., by the object classification component 112)what portion of the touch sensitive surface 104 is in contact with orproximity to the object(s) 1108. The object classification component112, for example, in conjunction with the processor 1110, can receivethe signals from the touch sensing system 102 and can analyze thesignals to detect strokes or other contact made by an object(s) 1108against the touch sensitive surface 104 or detect an object(s) 1108 inproximity to the touch sensitive surface 104.

In some embodiments, the touch sensitive device 1100 further cancomprise a memory system 1114. The memory system 1114 can be capable ofstoring and providing programming and other forms of instructions to theprocessor 1110 and/or other components (e.g., object classificationcomponent 112, event determination component 114, . . . ) and that canbe used for other purposes. The memory system 1114 can include read onlymemory (ROM), random access memory (RAM) (e.g., random accesssemiconductor memory), and/or other types of memory or computer readablemedia that can be permanently installed or separably mounted (e.g.,connected or interfaced) to the touch sensitive device 1100.Additionally, the touch sensitive device 1100 also can access a memorysystem 1114 that can be separate from the touch sensitive device 1100 byway of an optional communication system 1116 (comm. system).

With further regard to the processor 1110, the processor 1110 canoperate in conjunction with other components (e.g., touch sensing system102, touch sensitive surface 104, sensor component 106, objectclassification component 112, event determination component 114, . . . )of the touch sensitive device 1100 to facilitate performing the variousfunctions of the touch sensitive device 1100. The processor 1110 canemploy one or more processors, microprocessors, or controllers that canprocess data, such as information relating to user data, applications,messages, message or data formatting, data conversions, touch surfacedata, motion, data, vibro-acoustic data, orientation data, touch data,other types of data, contact classifications, contact states, events orresponsive actions, resources, and/or other information, to facilitateoperation of the touch sensitive device 1100, as more fully disclosedherein, and control data flow between the touch sensitive device 1100and other components or devices of or associated with the touchsensitive device 1100.

The memory system 1114 can comprise a data store that can store datastructures (e.g., user data, metadata), code structure(s) (e.g.,modules, objects, hashes, classes, procedures) or instructions,information relating to user data, applications, messages, message ordata formatting, data conversions, touch surface data, motion, data,vibro-acoustic data, orientation data, touch data, other types of data,contact classifications, contact states, events or responsive actions,resources, and/or other information, to facilitate controllingoperations associated with the touch sensitive device 1100. In someimplementations, the processor 1110 can be functionally coupled (e.g.,through a memory bus) to the memory system 1114, including the datastore, in order to store and retrieve information desired to operateand/or confer functionality, at least in part, to the touch sensingsystem 102, touch sensitive surface 104, sensor component 106, objectclassification component 112, event determination component 114, etc.,and/or substantially any other operational aspects of the touchsensitive device 1100.

The touch sensitive device 1100 also can comprise one or more othercomponents (e.g., one or more other optional components) such as, forexample, an audio system 1118 that can comprise an audio sensor(s) 1120,such as a microphone(s) and or a connection to a microphone(s), and anaudio output 1122, such as a speaker(s) or a connection to a speaker(s).The touch sensitive device 1100 also can include, as illustrated, aninterface component 1124 (e.g., interface unit), a signal processingcomponent 1126 (e.g., signal processing unit), and a database component1128.

With further regard to the sensors of the sensor component 106, thesensors can take any of a variety of forms and can comprise generallyany known device for sensing conditions inside or outside of the touchsensitive device 1100. The sensors of the sensor component 106 can,without limitation, comprise or take the form of acoustic sensors,accelerometers, gyroscopes, light sensors, range finders, thermometers,Hall effect sensors, switches (e.g., 2-way, 4-way switch, 6-way switch,8-way switch), mouse and trackball systems, a joystick system, a voicerecognition system, a video-based gesture recognition system or othersuch systems, radio frequency identification (RFID) and near fieldcommunication sensors, bar code sensors, position sensors, and/or othersensors that can be used to detect conditions that can be useful ingoverning operation or performing functions of image or presencesensing, and can convert this sensed information into a form that can beused by the object classification component 112 and the processor 1110in controlling (e.g., governing) operation of the touch sensitive device1100. The sensors also can comprise biometric sensors that can beadapted to detect characteristics of a user or entity for security andaffective imaging purposes.

Alternatively or additionally, sensors of the sensor component 106 caninclude accelerometers, vibration sensors, ultrasonic sensors,piezoelectric devices, and/or other sensing circuits or systems that cansense vibrations or sounds that can be indicative of contact between anobject 1108 and the touch sensitive surface 104.

The sensors of the sensor component 106 also can comprise pressuresensors that can sense an amount of pressure applied by an object 1108against the touch sensitive surface 104. In some embodiments, the touchsensitive surface 104 can be of a type that can sense not only whichportion of the touch sensitive surface 104 has been contacted by anobject 1108, but also can sense an amount of pressure applied againstthe touch sensitive surface 104. One or more of various sensors andsensing technologies can be employed that can sense different levels ofpressure against the touch sensitive surface 104.

In still other embodiments, the sensors of the sensor component 106 caninclude one or more sensors 1130 (e.g., a force sensor) that canoptionally be incorporated in or on object 1108 (e.g., stylus) and thatcan sense conditions indicative of an amount of force applied betweenthe object 1108 and the touch sensitive surface 104. In suchembodiments, a force sensor 1130 can take the form of, for example andwithout limitation, a piezoelectric sensor, a stress sensor, a strainsensor, a compression sensor, a deflection sensor, or a resilientlybiased sensing system that can sense force (e.g., sense an amount offorce) based at least in part on an extent of deflection movement of acontact surface against the force of the resilient member and that cangenerate a signal (e.g., sensor data, such as force data) that can beindicative of the amount of force applied by or through an indicatoragainst the touch sensitive surface 104.

Such a force sensor 1130 can be directly connected to the interfacecomponent 1124 by way of a wired connection or a wireless connection,such as by an optional wireless communication module 1132 that can becapable of communication with the communication system 1116.

In certain embodiments, force sensing can be achieved by providing anobject 1108, such as a stylus as illustrated in FIG. 11, that can have arounded flexible tip such as a rubber or metallic mesh tip that can bearranged in a resilient manner to flatten when pressed against the touchsensitive surface 104 thereby increasing the amount of surface area ofthe tip of the object 1108 in contact with the touch sensitive surface104. In such embodiments, the size of the area of the tip of the object1108 in contact with the touch sensitive surface 104 can be an effectiveproxy for the amount of force applied by a user against the touchsensitive surface 104, and, in this regard, a touch sensitive surface104 that is capable of sensing area of the tip of the object 1108 thatis in contact with the touch sensitive surface 104 can be used for thispurpose by the disclosed subject matter. The disclosed subject matter(e.g., the touch sensitive surface 104) can achieve similar results,with proper calibration, using a fingertip of the user or another object1108.

The communication system 1116 can take the form of any optical, radiofrequency, or other circuit or system that can convert data into a formthat can be conveyed to an external device by way of an optical signal,radio frequency signal, or other form of wired or wireless signal. Thecommunication system 1116 can be used for a variety of purposesincluding, but not limited to, sending and receiving instruction setsand exchanging data with remote sensors or memory systems.

With further regard to the interface component 1124, the interfacecomponent 1124 can receive signals (e.g., sensor data, audio signals,and/or other data), for example, from the touch sensing system 102, theaudio system 1118, and/or other sensors of the sensor component 106, orany components thereof. The interface component 1124 can process thesesignals for use by the object classification component 122, theprocessor 1110, the signal processing component 1126 (e.g., taking theform of a signal processor or signal processing circuit), and/or anothercomponent(s) of the touch sensitive device 1100.

The interface component 1124 can, for example, be connected to outputs(e.g., output ports) from the touch sensing system 102, the audio system1118, and/or sensors of the sensor component 106. If signals from anoutput are in analog form, the interface component 1124 can includeanalog to digital converters that can convert such analog signals intodigital signals that can be used by the object classification component112, the processor, 1110, the signal processing component 1126, and/oranother component(s) of the touch sensitive device 1100. The interfacecomponent 1124 also can include amplifiers, filters, including, but notlimited to, noise filters, band pass/band reject filters or couplings,breakers, fusible links, and/or other systems that can protect othercomponents of the touch sensitive device 1100 from potential damage.

In some embodiments, the touch sensitive device 1100 can utilizemultiple sources of vibro-acoustic signals with one or more sensors(e.g., one or more sensors for in-air acoustics, and one or more sensorsfor mechanical vibrations, also referred to as structural acoustics).The touch sensitive device 1100 can utilize one or more types of audiosensors 1120 or other types of sensors of the sensor component 106,wherein such audio sensors or other types of sensors can include, butare not limited to, for example:

-   -   piezoelectric bender elements;    -   piezoelectric film;    -   accelerometers (e.g., linear variable differential transformer        (LVDT), potentiometric, variable reluctance, piezoelectric,        piezoresistive, capacitive, servo (force balance), MEMS);    -   displacement sensors;    -   velocity sensors;    -   vibration sensors;    -   gyroscopes;    -   proximity sensors;    -   electric microphones;    -   hydrophones;    -   condenser microphones;    -   electret condenser microphones;    -   dynamic microphones;    -   ribbon microphones;    -   carbon microphones;    -   piezoelectric microphones;    -   fiber optic microphones;    -   laser microphones;    -   liquid microphones; and/or    -   MEMS microphones.

Many touchscreen computing devices can include microphones andaccelerometers (e.g., for voice and input sensing). Such microphones andaccelerometers can be utilized by the device (e.g., touch sensitivedevice 1100) without having to employ additional sensors or can work inconcert with other sensors (e.g., specialized sensors performingparticular or specified functions).

To this end, the interface component 1124 can receive signals (e.g.,sensor data) from the audio sensor 1120 or another sensor of the sensorcomponent 106 that can sense vibrations, and can prepare the signals foruse by the signal processing component 1126 or another component of thetouch sensitive device 1100. For example, the interface component 1124can convert such signals from analog form into corresponding digitalsignals, and can provide the digital signals, which can be a digitalsignal representative of conditions sensed by audio sensor 1120 and theother sensor of the sensor component 106, to the signal processingcomponent 1126 or the other component.

The interface component 1124 also can receive signals (e.g., controlsignals or instructions) from the processor 1110, the signal processingcomponent 1126, the object classification component 112, and/or theevent determination component 114, and can use these signals to controloperation of the touch sensitive surface 104, the display system 1102,including the display screen 1104, the audio system 1118, and/or thecommunication system 1116. In this regard, the interface component 1124can include display drivers, audio output systems, including amplifiers,and the like. It will be appreciated and understood that some or all ofthe functions ascribed to the interface component 1124 can be performedby hardware or programs that can be integrated within the touch sensingsystem 102, the display system 1102, the audio system 1118, the sensorsof the sensor component 106, the object classification component 112,the event determination component 114, or the communication system 1116.

The signal processing component 1126 can receive signals from theinterface component 1124, which can be in digital form, and can preparethe signals for further processing. The signal processing component 1126can perform sampling, quantization, and/or encoding processes, and, asdesired, also can be used in converting analog signals into a digitalsignal (e.g., if a received signal is in analog form). The signalprocessing component 1126 can transmit the digital signals (e.g., thesignal-processed digital signals) to the processor 1110, the objectclassification component 112, and/or another component of the touchsensitive device 1100.

As more fully disclosed herein, the object classification component 112and/or the processor 1110 (e.g., operating in conjunction with theobject classification component 112) can determine a contactclassification or contact state for an object(s) with respect to thetouch sensitive surface 104 based at least in part on touch surface dataassociated with the touch sensitive surface 104, motion data relating tomotion of the touch sensitive device 1100, and/or other data (e.g.,orientation data, touch data, . . . ). In some embodiments, the eventdetermination component 114 (e.g., event determining unit) can determinethat an event with respect to the touch sensitive surface 104 and/ortouch sensitive device 1100 has occurred based at least in part on thecontact classification of the object(s), and the event determinationcomponent 114 and/or the processor 1110 can use this event determinationto control operation of the touch sensitive device 1100 (e.g., the touchsensitive surface 104 of the touch sensitive device 1100). For example,the event determination component 114 can control operation of the touchsensitive surface 104 (e.g., enable or disable a touch function(s) ofthe touch sensitive surface 104) and/or the display screen 1104 (e.g.,turn the display screen 1104 to an on state or an off state) based atleast in part on the determined event, in accordance with the definedclassification criteria, as more fully described herein. In certainembodiments, the database component 1128 also can be provided, whereinprogram software and other data can be stored in the database component1128 (and/or a data store of the memory system 1114).

In accordance with various embodiments and aspects of the disclosedsubject matter, at least some of functions of the interface component1124, the signal processing component 1126, the object classificationcomponent 112, the event determination component 114, the databasecomponent 1128, and/or another component(s) of the touch sensitivedevice 1100 can be or can comprise program modules to control orcommunicate with other hardware components or components for executingsoftware, which can be included, for example, in the touch sensitivedevice 1100, wherein such other components can include, for example, andwithout limitation, the processor 1110, the memory system 1114, theinterface component 1124, and/or the signal processing component 1126.The program modules can be included in the touch sensitive device 1100in the form of operating systems, application program modules, or otherprogram modules, wherein they can be physically stored in a variety ofstorage devices (e.g., data stores). Further, the program modules alsocan be stored in a remote storage device that can communicate with thetouch sensitive device 1100 by way of the communication system 1116.Meanwhile, such program modules can include, but are not limited to,routines subroutines, programs, objects, components, data structures,and the like, for performing specific tasks or executing specificabstract data types as described herein, in accordance with thedisclosed subject matter. Such program modules also can be expressed interms of configurations of hardware adapted to perform the functionsassociated with such modules.

The object classification component 112 can analyze the signals (e.g.,digital signals) transmitted from the signal processing component 1126or other component (e.g., a sensor(s)). Based at least in part on theresults of the analysis, the object classification component 112 candetermine whether an object(s) 1108 has been brought into contact with,or in proximity to, the touch sensitive surface 104, and can classifythe type of object(s) 1108 brought into contact with, or in proximityto, the touch sensitive surface 104, in accordance with the definedclassification criteria.

In general, when the object classification component 112 characterizessuch an object, the object classification component 112 can receive asignal having frame information in the form of x,y coordinate valueswith each of the x,y coordinate values representing which portions ofthe touch sensitive surface 104 are in contact with the object 1108. Thetouch sensitive surface 104 (e.g., sensors of or associated with thetouch sensitive surface 104) can obtain such x,y coordinate values bysampling the touch sensitive surface 104 at a specified (e.g.,predetermined) rate, such as, for example, 100 times per second, 60times per second, 30 times per send, or at another desired sampling orsensing rate. In one such embodiment, the positions of the touchsensitive surface 104, if any, that are in contact with, or in proximityto, the object 1108 can be sensed (e.g., by respective sensorsassociated with the respective positions) at a desired sampling orsensing rate, and frame data can be generated (e.g., by the objectclassification component 112, respective sensors, and/or anothercomponent), wherein the frame data can represent an x-coordinate valueand a y-coordinate map indicative of the positions of contact orhovering between the object 1108 and the touch sensitive surface 104. Insome embodiments, the frame data also can comprise respective intensityvalues that can be determined (e.g., by the object classificationcomponent 112, respective sensors, and/or another component) for andassigned to respective x-y coordinate values.

The object 1108 can comprise any object that can come in contact with orbe in proximity to the touch sensitive surface 104 and that can bedetected by the touch sensitive surface 104 (e.g., sensors of orassociated with the touch sensitive surface 104). Although listed insingular form as “object” 1108, it will be appreciated that for thepurposes of this disclosure an “object” can comprise any combination ofitems that can be brought into contact with or in proximity to the touchsensitive surface 104 during a frame, wherein the items of the object1108 can include, but not limited to, fingers of a user, combinations ofdifferent parts of the fingers, indicators including styluses or pens(e.g., utilized by the user), different parts of a body of the user,such as a head, ear, cheek bone, mouth, face, skin, beard or hair, hats,headgear, and/or head wrappings, or combinations thereof.

In certain embodiments, an object 1108 can take the form of anelectronic pen, stylus, or other tool with or without electric circuitstherein, which may or may not belong to the touch sensitive device 1100,except when an object 1108 is a body part of the user, such as theuser's finger, ear, etc. An object 1108 can be made of variousmaterials, such as, for example, metal, wood, plastic, rubber, and/orglass. An object 1108 also can comprise body parts of a user, such asfingers, hands, arms, head, and/or neck of the user. When an object 1108is the user's finger, each of the specific parts of the finger can be orbecome the object 1108, in accordance with the disclosed subject matter,because fingers usually can be constituted by various parts such asfinger tips, finger nails, knuckles, and finger joints.

The object classification component 112 can analyze and use the x,ycoordinate data (e.g., frame data), which can represent respectiveportions of the touch sensitive surface 104 in contact with an object1108 and/or any intensity data from the frame data. Based at least inpart on the results of analyzing the frame data (e.g., the x,ycoordinate data and/or the intensity data), the object classificationcomponent 112 can classify the nature of the contact(s) or hoveringsensed by the touch sensitive surface 104 (e.g., the objectclassification component 112 can determine the contact classificationand contact state with respect to the object 1108 and the touchsensitive surface 104).

The operation of the object classification component 112, with regard tovarious aspects and embodiments of the disclosed subject matter, can beillustrated with reference to FIGS. 13-17 (along with FIGS. 11 and 12).FIG. 13 illustrates a flow diagram of an example method 1300 forclassifying contacts against or in proximity to the touch sensitivesurface 104 of the touch sensitive device 1100, in accordance withvarious aspects and embodiments of the disclosed subject matter. As isshown in FIG. 13, at reference numeral 1302, frame data associated withthe touch sensitive surface can be received (e.g., by the objectclassification component 112). Turning briefly to FIG. 14 (along withFIGS. 11-13), FIG. 14 depicts a diagram of an example frame image 1400as part of a visual representation 1450 of a top view of the exampletouch sensitive device 1100, wherein the example frame image 1400 cancomprise or represent certain frame data relating to an example sensingof an object in contact with the touch sensitive surface 104, inaccordance with various aspects and embodiments of the disclosed subjectmatter. In this example, the frame data depicted in the image 1400 wassensed, for example and without limitation, when an object (e.g., 1108),such as an ear of the user is in contact with the touch sensitivesurface 104.

In the touch sensitive device 1100, the object classification component112 can receive the frame data representing x,y coordinates of eachportion of the touch sensitive surface 104 that is in contact with (orin proximity to (if such is the case)) another surface (of an object1108), and the object classification component 112 can perform a method(e.g., method 1300) for classifying a type of contact (or hovering). Theobject classification component 112 can supply the contactclassification, determined by the object classification component 112,to the event determination component 114 for further processing oraction, as more fully described herein.

With further regard to the method 1300 of FIG. 13, in some embodiments,at reference numeral 1304, to facilitate determining the contactclassification (e.g., performed by the object classification component112), a subdivision analysis can be performed. In the subdivisionanalysis, the object classification component 112 can divide (e.g.,partition, segregate) the frame data into respective subdivisionscomprising respective portions of the frame data. The objectclassification component 112 can analyze each subdivision to identify ordetermine characteristics of the portion of the frame data associatedwith the subdivision that may or may not indicate consistency with thedetermined classification (e.g., determined contact classification).There can be various forms for such subdivisions. These subdivisions canbe demarcated for the purposes of the following description of thedisclosed subject matter in terms of bounding areas, and a variety ofbounding area shapes can be usable, for example, as determined by theobject classification component 112, in accordance with the definedclassification criteria. In accordance with various embodiments, thebounding area shapes can be mutually exclusive, that is, defined so thatno portion of a bounding area overlaps a portion of another boundingarea, or bounding area shapes can be defined so that the bounding areascan at least in part overlap with each other.

The example image 1400 of FIG. 14 illustrates one example of frame data1402, wherein respective portions of the frame data 1402 can be inrespective bounding areas 1404 of a pattern 1406 of bounding areas 1404,wherein the pattern 1406 of bounding areas 1404 can be used by theobject classification component 112 when the object classificationcomponent 112 performs a subdivision analysis on the frame data 1402, inaccordance with various aspects and embodiments of the disclosed subjectmatter. In the example frame image 1400 of FIG. 14, the objectclassification component 112 can utilize a generally uniformly patternedarray 1408 of bounding areas 1404 to subdivide the frame data 1402 amongthe respective bounding areas 1404 of the array 1408. However, it is tobe appreciated and understood that the pattern 1406 does not have to beuniform in nature.

Referring briefly to FIG. 15 (along with FIGS. 11-13), FIG. 15 presentsa diagram of an example frame image 1500 as part of a visualrepresentation 1550 of a top view of the example touch sensitive device1100, wherein the example frame image 1500 can comprise or representcertain frame data subdivided among non-uniform bounding areas, whereinthe frame data relates to an example sensing of an object in contactwith the touch sensitive surface 104, in accordance with various aspectsand embodiments of the disclosed subject matter. For example, as shownin the example frame image 1500 of FIG. 15, the example frame image 1500can comprise or represent certain frame data 1502, which, in thisexample, can depict an object (e.g., an ear of a user) in contact with(or in proximity to) the touch sensitive surface 104.

The object classification component 112 can divide (e.g., subdivide)respective portions of the frame data 1502 into respective boundingareas 1504 (e.g., respective subdivisions) in the form of a pattern 1506of bounding areas 1504. The bounding areas 1504 can be non-uniform insize, wherein the bounding areas 1504 of the pattern 1506 can bedifferently sized, and wherein there can be virtually any desired numberof different sizes for the bounding areas 1504 in the pattern 1506. Inthis example frame image 1500, the pattern 1506 of bounding areas 1504can include a first bounding area 1508 of a first size, a secondbounding area 1510 of a second size, a third bounding area 1512 of athird size, and so on. The object classification component 112 can usethe pattern 1506 of bounding areas 1504 to perform a subdivisionanalysis on the frame data 1502 to facilitate determining a contactclassification or contact state with respect to the contact (orhovering) of an object with the touch sensitive surface 104, inaccordance with various aspects and embodiments of the disclosed subjectmatter.

Turning briefly to FIG. 16 (along with FIGS. 11-13), FIG. 16 illustratesa diagram of an example frame image 1600 as part of a visualrepresentation 1650 of a top view of the touch sensitive device 1100,wherein the example frame image 1600 can comprise or represent certainframe data subdivided among non-uniform variously shaped bounding areas,wherein the frame data relates to an example sensing of an object incontact with the touch sensitive surface 104, in accordance with variousaspects and embodiments of the disclosed subject matter. For example, asshown in the example frame image 1600 of FIG. 16, the example frameimage 1600 can comprise or represent certain frame data 1602, which, inthis example, can depict an object (e.g., an ear of a user) in contactwith (or in proximity to) the touch sensitive surface 104.

The object classification component 112 can divide (e.g., subdivide)respective portions of the frame data 1602 into respective boundingareas 1604 (e.g., respective subdivisions) in the form of a pattern 1606of bounding areas 1604. The pattern 1606 of bounding areas 1604 can haverespective bounding areas 1604 that can be shaped and size in any of avariety of configurations, in accordance with the defined classificationcriteria. For instance, the bounding areas 1604 can be non-uniform insize and shape, wherein the bounding areas 1604 of the pattern 1606 canbe differently sized and/or differently shaped, and wherein there can bevirtually any desired number of different sizes and/or different shapesfor the bounding areas 1604 in the pattern 1606. As illustrated in theframe image 1600, the pattern 1606 of bounding areas 1604 can comprise,for example, a first bounding area 1608 having a first size and firstshape, a second bounding area 1610 having a second size and a secondshape, a third bounding area 1612 having a third size and a third shape,and so on. In some implementations, some bounding areas 1604 of thepattern 1606 of bounding areas 1604 can overlap other bounding areas1604, as depicted at 1614. The object classification component 112 canuse the pattern 1606 of bounding areas 1604 to perform a subdivisionanalysis on the frame data 1602 to facilitate determining a contactclassification or contact state with respect to the contact (orhovering) of an object with the touch sensitive surface 104, inaccordance with various aspects and embodiments of the disclosed subjectmatter.

Referring briefly to FIG. 17 (along with FIGS. 11-13), FIG. 17 depicts adiagram of an example frame image 1700 as part of a visualrepresentation 1750 of a top view of the example touch sensitive device1100, wherein the example frame image 1700 can comprise or representcertain frame data associated with contact or association of an objectwith the touch sensitive surface 104, wherein the example frame image1700 can be subdivided to form variously shaped bounding areas that canbe determined based at least in part on the frame data, in accordancewith various aspects and embodiments of the disclosed subject matter.The frame data can relate to an example sensing of an object in contactwith the touch sensitive surface 104. For example, as illustrated in theexample frame image 1700 of FIG. 17, the example frame image 1700 cancomprise or represent certain frame data 1702, which, in this example,can depict an object (e.g., an ear of a user) in contact with (or inproximity to) the touch sensitive surface 104.

The object classification component 112 can divide (e.g., subdivide)respective portions of the frame data 1702 into respective boundingareas 1704 (e.g., respective subdivisions) in the form of a pattern 1706of bounding areas 1704. The object classification component 112 candetermine the bounding areas 1704 based at least in part on the framedata 1702 (e.g., the distribution of the frame data 1702 in the frameimage 1700). For instance, the object classification component 112 candetermine the number of bounding areas 1704 and the respective shapes ofthe respective bounding areas 1704 based at least in part on thedistribution or concentration of the frame data 1702 in the frame image1700, wherein the pattern 1706 can delineate different bounding areas1704 around respective concentrated portions of contact (or hovering)with the touch sensitive surface 104. The object classificationcomponent 112 can use the pattern 1706 of bounding areas 1704 to performa subdivision analysis on the frame data 1702 to facilitate determininga contact classification or contact state with respect to the contact(or hovering) of an object with the touch sensitive surface 104, inaccordance with various aspects and embodiments of the disclosed subjectmatter.

It is to be appreciated and understood that derivatives of all theaforementioned boundary arrangements can be used (first and secondorder) by the object classification component 112. For instance, anydesired combination of the respective types of subdivisioning of framedata can be employed by the object classification component 112. Forexample, with respect to frame data represented in an image, the objectclassification component 112 can determine some bounding areas for someportions of the image based at least in part on the frame data (e.g.,the distribution or concentration of the frame data), and, with regardto other portions of the image, the object classification component 112can determine other bounding areas (e.g., substantially uniform boundingareas; or variously shaped and/or sized bounding areas).

In some embodiments, the object classification component 112 can employa predetermined pattern of bounding areas to subdivide the frame data tofacilitate performing a subdivision analysis on the frame data.Alternatively, the object classification component 112 can dynamicallydetermine a pattern of bounding areas to subdivide the frame data, basedat least in part on a mode of operation of the touch sensitive device1100, to facilitate performing a subdivision analysis on the frame data,in accordance with the defined classification criteria (e.g.,classification criteria relating to subdivision analysis of frame data).

The object classification component 112 can perform the subdivisionanalysis on the frame data by analyzing the respective portions of framedata within the respective subdivisions defined by the bounding areas ofthe pattern of bounding areas to determine a potential contact type foreach subdivision (at reference numeral 1304). This can be done, forexample, by the object classification component 112 determining whetherthere is a pattern analysis of the frame data that is consistent withthe subdivision analysis. The object classification component 112, aspart of this pattern analysis, can use a desired pattern identificationmethod or technique to identify or locate patterns of touch indicativeof touch with certain objects, such as by identifying patterns withinthe subdivisions of the pattern of bounding areas. The objectclassification component 112 can determine a contact classification forthe object in contact with, or in proximity to, the touch sensitivesurface 104, in response to determining that a pattern analysis isconsistent with the subdivision analysis. In some embodiments, theobject classification component 112 can determine the contactclassification based at least in part on touch intensity of the contact(e.g., touch) of the object with the touch sensitive surface 104. Theobject classification component 112 (or another component of the touchsensitive device 1100) can determine (e.g., compute) touch intensity ofa contact of an object with the touch sensitive surface 104 in a varietyof manners.

For example, the object classification component 112 (or anothercomponent of the touch sensitive device 1100) can determine a touchintensity of a contact of an object with the touch sensitive surface 104based at least in part on one or more defined threshold values relatingto touch intensity. For instance, if the object classification component112 determines that the touch intensity of the contact is above adefined threshold value, the object classification component 112 candetermine that the touch (e.g., contact) has a high intensity. If,however, the object classification component 112 determines that thetouch intensity of the contact is below the defined threshold value, theobject classification component 112 can determine that the touch (e.g.,contact) has a low intensity.

In some embodiments, the object classification component 112 can employmore than one defined threshold value, wherein, for example, the objectclassification component 112 can determine whether the touch intensityof a contact of an object with the touch sensitive surface 104 is abovea first defined threshold value relating to a high touch intensity, isbelow a second defined threshold value relating to a low touchintensity, or is between (or at one of) the first defined thresholdvalue and the second defined threshold value. The object classificationcomponent 112 can determine that a touch intensity above the firstdefined threshold value is a high intensity, a touch intensity below thesecond defined threshold value is a low intensity, and a touch intensitybetween (or at one of) the first defined threshold value and the seconddefined threshold value is a medium intensity.

Alternatively, the object classification component 112 can determine atouch intensity of a contact of an object with the touch sensitivesurface 104 as a continuous numerical value, for example, between 0.0and 100.0. In such case, the object classification component 112 candetermine the number of types of the touch intensities of contactaccording to a number of criteria (e.g., defined classification criteriarelating to touch intensity) to distinguish the magnitude of theamplitude intensity of a contact of an object with the touch sensitivesurface 104.

Since the touch intensity potentially can change radically depending onthe object 1108 that has applied the touch to the touch sensitivesurface 104, it can be advantageous for the object classificationcomponent 112 to determine, and the object classification component 112can determine, an object type criteria in order to facilitatedistinguishing the magnitude of the amplitude of the digitalsound/vibration signal with respect to the individual types of objects(e.g., 1108) and facilitate determining a contact classification of anobject with respect to the touch sensitive surface 104. The objectclassification component 112 can make such determination of the objecttype criteria in any of a variety of ways. For example, suchdiscrimination can be performed (e.g., by the object classificationcomponent 112) at least in part by using vibro-acoustic data such as isdescribed in a commonly assigned and co-pending U.S. patent applicationSer. No. 14/612,089, entitled “Method and Apparatus for ClassifyingTouch Events on a Touch Sensitive Surface,” filed on Feb. 2, 2015, andincorporated by reference herein in its entirety. U.S. patentapplication Ser. No. 14/612,089 in part describes an apparatus forclassifying touch events having a touch sensitive surface configured togenerate a touch event when an object or finger touches the touchsensitive surface, wherein the touch event entails a mechanicalvibration generated upon contact with the surface, a touch detectorconfigured to detect the onset of a touch, and a touch event classifierconfigured to classify the touch event to identify the object used forthe touch event. The object classification component 112 can employ suchtechniques to facilitate determining the object type criteria for anobject and facilitate determining a contact classification of an objectwith respect to the touch sensitive surface 104.

Additionally, such a determination of the object type criteria also canbe performed (e.g., by the object classification component 112) at leastin part using the techniques described in commonly assigned andco-pending “Capture of Vibro-Acoustic Data used to Determine TouchTypes,” U.S. patent application Ser. No. 13/958,427, filed on Aug. 2,2013 and incorporated herein by reference in its entirety. U.S. patentapplication Ser. No. 13/958,427 describes in part a method forinteraction between a user and an electronic device having a touchsensitive surface. In this method, a touch event trigger can be receivedthat can indicate an occurrence of a physical touch event on thetouch-sensitive surface. Touch data produced by the touch event can beaccessed and vibro-acoustic data for a vibro-acoustic signal produced bythe physical touch event can be accessed for a time window that beginsat a time that is prior to receipt of the touch event trigger, and atouch type for the touch event can be determined based on the touch dataand the vibro-acoustic data. The object classification component 112 canemploy such method and techniques to facilitate determining the objecttype criteria for an object and facilitate determining a contactclassification of an object with respect to the touch sensitive surface104.

In some embodiments, such a determination of the object type criteriacan be performed (e.g., by the object classification component 112) atleast in part using the techniques described in commonly assigned andco-pending U.S. patent application Ser. No. 14/219,919, entitled “Methodand Device for Sensing Touch Inputs”, filed on Mar. 19, 2014 andincorporated herein by reference in its entirety. U.S. patentapplication Ser. No. 14/219,919 describes, in part, a method for sensingtouch inputs to digital equipment in which a sound/vibration signal thatis generated by a touch can be sensed, and the sensed sound/vibrationsignal can be digitally processed. Here, the type of touch means as wellas a touch intensity of such touch can be determined based on featuresderived from time and frequency domain representations of the processedsound/vibration signal. The object classification component 112 canemploy such method and techniques to facilitate determining the objecttype criteria for an object and facilitate determining a contactclassification of an object with respect to the touch sensitive surface104.

In certain embodiments, the object classification component 112 candetermine touch intensity of contact of an object with the touchsensitive surface 104 based at least in part on vibro-acousticdifferences between contact made by the object with the touch sensitivesurface 104 when different parts of an input tool contact the touchsensitive surface 104. One example of such techniques for determiningtouch intensity of contact of an object with a touch sensitive surfacecan be found in commonly assigned and co-pending U.S. patent applicationSer. No. 13/780,494, entitled “Input Tools Having Vibro-AcousticallyDistinct Regions and Computing Device For Use With Same,” filed on Feb.28, 2013, and incorporated herein by reference in its entirety. U.S.patent application Ser. No. 13/780,494 describes in part an input toolfor interacting with a touch screen, the input tool comprising: a bodyin the form of a stylus, the body having one or more vibro-acousticallydistinct regions, wherein each vibro-acoustically region can produce adiscrete vibro-acoustic signal when it touches a surface of the touchscreen, and the vibro-acoustic signal can be used to detect what regionof the input tool was used. Such vibro-acoustic signals also can be used(e.g., by the object classification component 112) to discriminatebetween different types of finger contacts, such as contact with theknuckle, fingernail, and/or fingertip, as is described in commonlyassigned and co-pending U.S. patent application Ser. No. 13/849,698,entitled “Method and System For Activating Different InteractiveFunctions Using Different Types of Finger Contact,” filed on Mar. 25,2013, and incorporated by reference in its entirety.

Finger touch type determinations (e.g., by the object classificationcomponent 112) with respect to the touch sensitive surface 104 can, forexample, result in execution (e.g., by the object classificationcomponent 112, event determination component 114, and/or processor 1110)of a first action for a first finger touch type and/or a second actionfor a second finger touch type. For example, U.S. patent applicationSer. No. 13/887,711, entitled “Using Finger Touch Types to Interact withElectronic Devices,” filed on May 6, 2013, and incorporated by referencein its entirety describes such an application with respect to respectiveactions being performed for respective finger touch type determinations.

The object classification component 112 also can perform touch intensityanalysis with regard to an object in contact with or in proximity to thetouch sensitive surface 104 based at least in part on capacitive dataobtained from one or more sensors of or associated with the touchsensitive surface 104. For example, the commonly assigned and co-pendingU.S. patent application Ser. No. 14/191,329, entitled “Using CapacitiveImages for Touch Type Classification,” filed on Feb. 26, 2014, describesin part a method of interaction between a user and an electronic devicehaving a touch sensitive surface. In one aspect of this, a capacitiveimage can be accessed, wherein the capacitive image can comprisecapacitive image data that can correspond to respective capacitances atrespective locations on the touch sensitive surface, wherein therespective capacitances can vary in response to a physical touch by anobject on the touch-sensitive surface. The capacitive image data can beprocessed and a touch type can be determined for the physical touchbased at least in part on the processed capacitive image data. It alsocan be useful to, where possible or appropriate to do so, have theobject classification component 112 maintain heuristic data regardingsuch objects.

Sensors (e.g., surface-related sensors 108) of the sensor component 106and/or the object classification component 112 can generate or determinetouch intensity data relating to the intensity of the touching of anobject 1108 with the touch sensitive surface 104 based at least in partthe touch intensity between the object 1108 and the touch sensitivesurface 104, which in turn can be determined, for example, based atleast in part on the capacitance, resistance, or shear forcemeasurements obtained (e.g. by the sensors of the sensor component 106)in connection with the contact of the object 1108 with the touchsensitive surface 104. Additionally or alternatively, sensors (e.g.,surface-related sensors 108) of the sensor component 106 and/or theobject classification component 112 can generate or determine touchintensity data based at least in part sensed variations in an amount offorce applied against the touch sensitive surface 104, which can besensed (e.g., by the sensors) in the various ways described hereinand/or any other techniques for sensing force applied against a surface.

In some implementations, the object classification component 112 cantransmit object characterization information (e.g., to the eventdetermination component 114, processor 1110, or another component),wherein the object characterization information can relate tocharacteristics of the object 1108, including the relationship (e.g.,contact or hovering) between the object 1108 and the touch sensitivesurface 104. Furthermore, the object classification component 112 cantransmit touch intensity data that can characterize an amount of forceor other touch intensity information that can characterize the intensityof a touch applied by or through an object 1108 during contact with thetouch sensitive surface 104. This can be done in one embodiment byproviding touch intensity data that corresponds to each element of touchintensity data or by sampling, mathematically processing or otherwiseprocessing force to characterize the amount of force or applied duringthe period in which frame data is obtained.

The analysis of frame data performed in each subdivision (e.g., by theobject classification component 112) in connection with determining acontact classification for an object 1108 with the touch sensitivesurface 104 can take a variety of forms including:

-   -   average (e.g., determining an average amount of force applied by        an object 1108 to the touch sensitive surface 104 during the        time period, based at least in part on the results of analyzing        the frame data);    -   standard deviation (e.g., determining a standard deviation        associated with the amounts of force applied by an object 1108        to the touch sensitive surface 104 during the time period, based        at least in part on the results of analyzing the frame data);    -   standard deviation (normalized by overall amplitude) (e.g.,        determining a standard deviation that can be normalized by        overall amplitude, based at least in part on the results of        analyzing the frame data);    -   variance (e.g., determining a variance of the amounts of force        applied by an object 1108 to the touch sensitive surface 104        during the time period, based at least in part on the results of        analyzing the frame data);    -   skewness kurtosis sum (e.g., determining a skewness kurtosis sum        relating to an amount of force or touch intensity applied by an        object 1108 to the touch sensitive surface 104 during the time        period, based at least in part on the results of analyzing the        frame data);    -   absolute sum (e.g., determining an absolute sum of an amount of        force or touch intensity applied by an object 1108 to the touch        sensitive surface 104 during the time period, based at least in        part on the results of analyzing the frame data);    -   root mean square (RMS) (e.g., determining an RMS value relating        to an amount of force or touch intensity applied by an object        1108 to the touch sensitive surface 104 during the time period,        based at least in part on the results of analyzing the frame        data);    -   crest factor (e.g., determining a crest factor with respect to        an amount of force or touch intensity applied by an object 1108        to the touch sensitive surface 104 during the time period, based        at least in part on the results of analyzing the frame data);    -   dispersion entropy power sum (e.g., determining a dispersion        entropy power sum with respect to an amount of force or touch        intensity applied by an object 1108 to the touch sensitive        surface 104 during the time period, based at least in part on        the results of analyzing the frame data);    -   centroid (center of mass) (e.g., determining a centroid with        respect to an amount of force or touch intensity applied by an        object 1108 to the touch sensitive surface 104 during the time        period, based at least in part on the results of analyzing the        frame data);    -   coefficient of variation zero-crossings (e.g., determining a        coefficient of variation zero-crossings with respect to an        amount of force or touch intensity applied by an object 1108 to        the touch sensitive surface 104 during the time period, based at        least in part on the results of analyzing the frame data);        and/or    -   template match scores for a set of known exemplar signals (e.g.,        determining template match scores for a set of known exemplar        signals in connection with an amount of force or touch intensity        applied by an object 1108 to the touch sensitive surface 104        during the time period, based at least in part on the results of        analyzing the frame data) using the following methods:    -   convolution,    -   inverse filter matching technique,    -   sum-squared difference (SSD), and/or    -   elastic matching.

In some embodiments, the touch sensing system 102, alone or incombination with other components (e.g., sensors, object classificationcomponent 112, processor 1110, . . . ) of the touch sensitive device1100, can generate additional data that can be of use in determiningcontact classifications or contact states with regard to objects and thetouch sensitive surface 104, wherein such additional data can includebut is not limited to:

-   -   a location of touch contact of the object 1108 with the touch        sensitive surface 104 (two-dimensional (2D), or        three-dimensional (3D) in the case of curved glass or other        non-planar geometry),    -   a size of touch contact of the object 1108 with the touch        sensitive surface 104 (some touch technologies of the disclosed        subject matter can provide an ellipse of the touch contact with        major and minor axes),    -   a rotation of the touch contact of the object 1108 with the        touch sensitive surface 104,    -   a shape of touch of the touch contact of the object 1108 with        the touch sensitive surface 104 (some touch technologies of the        disclosed subject matter can provide the actual shape of the        touch, and not just a circle or ellipse),    -   a surface area (e.g., in squared mm or pixels) of the touch        contact of the object 1108 with the touch sensitive surface 104,        a pressure of the touch of the object 1108 with the touch        sensitive surface 104 (which can be available on and determined        using the touch sensing system 102),    -   a shear of touch (which can be available on and determined using        the touch sensing system 102),    -   (“shear stress (which also can be called “tangential force”) can        arise from a force vector perpendicular to the surface normal of        a touchscreen (e.g., parallel to the touch sensitive surface).        This can be similar to normal stress—what is commonly called        pressure—which can arise from a force vector parallel to the        surface normal.”),    -   a number of touch contacts of the object 1108 with the touch        sensitive surface 104,    -   a capacitance of a touch of the object 1108 with the touch        sensitive surface 104 (if using a capacitive touch screen),    -   a swept frequency capacitance of touch of the object 1108 with        the touch sensitive surface 104 (if using a swept frequency        capacitive touch screen), and/or    -   a swept frequency impedance of touch of the object 1108 with the        touch sensitive surface 104 (if using a swept frequency        capacitive touch screen).

In some embodiments, the object classification component 112 candetermine or define a pattern of bounding areas in the frame data bytransforming the bounding areas into a frequency domain representation(e.g., using a Fast Fourier Transform (FFT) or a similar function). Forexample, with respect to frame data relating to contact or association(e.g., hovering) of an object 1108 with the touch sensitive surface 104,the object classification component 112 and/or another component (e.g.,processor 1110) can extract the following features from the frequencydomain representation of the bounding areas:

-   -   spectral centroid,    -   spectral density,    -   spherical harmonics,    -   total average spectral energy, and/or    -   log spectral band ratios.

To facilitate determining contact classifications or contact states withrespect to a contact or association of an object 1108 with the touchsensitive surface 104, the object classification component 112 can useany number of approaches, including, but not limited to, basicheuristics, decision trees, a Support Vector Machine, Random Forest,Naive Bayes, elastic matching, dynamic time warping, template matching,k-means clustering, K-nearest neighbors algorithm, neural network,Multilayer perceptron, multinomial logistic regression, gaussian mixturemodels, and/or AdaBoost.

In some embodiments, the object classification component 112 can combineresults obtained from performing several different classifyingtechniques through, for example, a voting scheme or through analysis ofa pattern from which it can be determined what portions of the touchsensitive surface 104 were in contact with, or in proximity to, anobject 1108 during a time period.

Based at least in part on the results of the analysis of the pertinentdata associated with the frame data, the object classification component112 can determine whether the pattern analysis classification isconsistent with the results of the subdivision analysis (at referencenumeral 1306). If, at reference numeral 1306, it is determined that thepattern analysis classification is not consistent with the results ofthe subdivision analysis, a subsequent frame can be received andanalyzed (the method 1300 can return to reference numeral 1302, and canproceed from there to reference numeral 1304, and thereafter, inaccordance with the method 1300). For instance, the objectclassification component 112 can obtain and analyze a subsequent frame,comprising subsequent frame data, to facilitate determining a contactclassification with respect to an object, as more fully describedherein.

If, however, at reference numeral 1306, the object classificationcomponent 112 determines that the pattern analysis classification isconsistent with the results of the subdivision analysis, the framecontact can be determined to be consistent with the pattern analysis orother classification, and any further analysis (if any), such as arefined analyses of the frame data, which may or may not be performedonce it is determined that the object 1108 is in contact with or inproximity to the touch sensitive surface 104, can be determined.

Once that a classification has been determined for the object 1108 incontact with touch sensitive device 1100, an event may be determined(e.g., by the event determination component 114) based at least in parton the classification. In order to reduce the chance or risk of falsepositive mode changes (e.g., switching to ear use), a number ofstrategies can be followed, with two exemplary strategies beingdescribed herein. The embodiments of FIG. 13 illustrate the first ofthese two exemplary strategies.

In such embodiments, the object classification component 112 or theevent determination component 114 can use frame data from more than onetime period to assist in the classification. For instance, at referencenumeral 1308, a contact classification (e.g., a frame contactclassification) can be compared with previous contact classificationdeterminations to determine a current contact state of an object 1108with respect to the touch sensitive surface 104. In accordance withreference numeral 1308 of the method 1300, the object classificationcomponent 112 or the event determination component 114 can compare acontact classification with previous contact classificationdeterminations to determine a current contact state of an object 1108with respect to the touch sensitive surface 104.

For example, the touch sensitive surface 104 (e.g., sensors of orassociated with the touch sensitive surface 104) can capture the touchimage and/or frame data at a particular frame rate (e.g., 30 frames persecond or another desired frame rate). The object classificationcomponent 112 or event determination component 114 can individuallyanalyze the respective frame data captured during these respectiveframes and determine respective classifications (e.g., “ear (or head)touching” or “no contact”) of the respective frames based at least inpart on the respective frame data. Although any contact or association(e.g., hover) in any given frame data potentially may have a lowerclassification confidence level, a more robust (e.g., a more confident)classification result typically can be achieved by using a small votingwindow. For example, if the last 10 touch screen frames had thefollowing classification result—“ear (or head), ear (or head), nocontact, ear (or head), no contact, ear (or head), ear (or head), ear(or head), ear (or head), no contact”—the result would be an “ear (orhead)” classification (6 out of the last 10 classification results).Similarly, there can be predetermined patterns classification changesover time for a contact that can be identified (e.g., by the objectclassification component 112 or event determination component 114) andused for contact classification purposes (e.g., by the objectclassification component 112 or event determination component 114). Forexample, it can be expected that there will be a rate of “no contact”determinations during an ear (or head) contact. For example, if it isexpected that three out of ten classifications of contacts orassociations (e.g., hover) during a period where an ear is held againstthe touch sensitive surface 104 (e.g., touch screen) will show nocontacts or if it is expected that at least one out of five frames willshow no contacts, the reliability of an ear (or head) contactclassification in the above example can be enhanced by the presence ofthe “no contact” determinations.

The contact classification determination made can be termed a currentcontact state, and, at reference numeral 1310 of the method 1300, anevent can be determined, based at least in part on the current contactstate associated with the touch sensitive surface 104. For instance, theevent determination component 114 can utilize the current contact staterelating to contact (or no contact) or association (e.g., hovering) ofan object 1108 with respect to the touch sensitive surface 104 (and/orassociated display screen 1104) to determine an event, based at least inpart on the current contact state associated with the touch sensitivesurface 104. The event can be an action (e.g., a response action) thatcan be performed by the event determination component 114, the processor1110, the touch sensitive surface 104, the touch sensing system 102, thedisplay screen 1104, the display system 1102, or another component ofthe touch sensitive device 1100, as appropriate. The event can comprise,for example, enabling a touch function(s) of the touch sensitive surface104 (or associated display screen 1104), disabling a touch function(s)of the touch sensitive surface 104 (or associated display screen 1104),turning the display screen 1104, or a portion of the display screen1104, on, or turning the display screen 1104, or a portion of thedisplay screen 1104, off.

In certain embodiments, the object classification component 112 (and/orthe event determination component 114) can determine and produce aclassification confidence in a contact classification determined by theobject classification component 112 (and/or the event determinationcomponent 114). To yield more robust behavior, the mode (e.g., functionmode of touch functions of the touch sensitive surface 104, display modeor power mode of the display screen 1104) of the touch sensitive device1100 can switch (e.g., will only switch) in response to the objectclassification component 112 or the event determination component 114determining that a contact classification(s) has a high confidence levelthat satisfies a defined threshold confidence (e.g., high confidencethreshold) level relating to confidence in the contact classification.If it is determined (e.g., by the object classification component 112 orthe event determination component 114) that the contactclassification(s) being produced has a low confidence level that doesnot satisfy (e.g., is below) the defined threshold (e.g., highconfidence threshold) classification level and/or is below a specifiedlow confidence threshold level, the event determination component 114can maintain the touch sensitive device 1100 in its current mode (e.g.,can maintain the touch sensitive surface 104 and/or display screen 1104in their respective current modes). At reference numeral 1312, themethod 1300 can terminate, or the method 1300 can continue by proceedingto reference numeral 1302 to receive further frame data and proceed fromthat point.

In certain embodiments, to facilitate avoiding “flickering” between twoor more modes of the touch sensitive device 1100 (e.g., rapidly andundesirably switching between operation modes of the touch sensitivesurface 104 and/or the display screen 1104), the event determinationcomponent 114 can utilize a hysteresis function that can facilitatecontrolling switching between operation modes of the touch sensitivesurface 104 and/or the display screen 1104.

It will be appreciated that there can be a variety of different contactclassifications and that more than one contact classification may befound in received frame data. Consider, for example, the scenarioillustrated in FIGS. 18 and 19. FIG. 18 illustrates a diagram of anexample scenario 1800 of a user having a touch sensitive device 1100against the side of the user's head. As is shown in the image of theexample scenario 1800 of FIG. 18, it is not uncommon for a user 1802 tohold a touch sensitive device 1100 (e.g., a cellular phone) against theuser's head 1804, such that contact between the touch sensitive surface104 and the head 1804 can exist in more than one place. As shown in theimage of the example scenario 1800, there can be several differentcontacts between head 1804 and the touch sensitive surface 104,including an ear contact 1806, a cheek contact 1808, and possibly a hairand/or head contact 1810.

FIG. 19 illustrates a diagram of an example frame image 1900 as part ofa visual representation 1950 of a top view of the touch sensitive device1100, wherein the example frame image 1900 can comprise or representframe data that can be determined during a time period when frame datafor a frame is acquired by the touch sensing system 102 and objectclassification component 112, in accordance with various aspects andembodiments of the disclosed subject matter. With regard to the frameimage 1900 of FIG. 19, the ear contact 1806 of FIG. 18 can yield acontact pattern 1902 that can correspond to the ear contact 1806, thecheek contact 1808 can provide a relatively uniform contact pattern 1904that can have an ovular shape and can correspond to the cheek contact1808, and the hair or head contact 1810 can yield a contact pattern 1906that can have some uniformity, but potentially can be influenced by thepresence of elongate striations 1908 due to contact with hair of theuser.

It will be appreciated that each of contact patterns 1902, 1904, and1906 can provide a signature that viewed collectively or individuallycan be capable of being classified (e.g., by the object classificationcomponent 112) or that can be capable of being used (e.g., by the objectclassification component 112) to corroborate a classification.

It is to be appreciated and understood that there can be many differentvariations of this. For example, a user may wear glasses that wraparound the rear of the ear and therefore are supported by the ear inways that potentially can adjust the contact pattern sensed by thesensors (e.g., surface-related sensors 108) of or associated with thetouch sensitive surface 104 when the touch sensitive device 1100 (e.g.,phone) is held up against an ear of the user. Similarly, the user maywear headgear that at least potentially can be sensed (e.g., by thesurface-related sensors 108) or piercings and/or jewelry that can besensed (e.g., by the surface-related sensors 108) and can createparticular contact patterns with the touch sensitive surface 104,wherein such contact can be, or at least potentially can be,particularly useful in determining (e.g., by the object classificationcomponent 112) when a head of a user is held against the touch sensitivesurface 104 of the touch sensitive device 1100.

FIG. 20 presents a diagram of an example frame image 2000 as part of avisual representation 2050 of a top view of the touch sensitive device1100, wherein the example frame image 2000 can comprise or representexample frame data of an example contact of an object with the touchsensitive surface 104, in accordance with various aspects andembodiments of the disclosed subject matter. The example frame image2000 can show another example further illustrating application of thetechniques and principles described herein. FIG. 20 illustrates a frameimage 2000 that can comprise or represent frame data having multiplecontacts 2002, 2004, and 2006. In this example, the objectclassification component 112 can perform the contact classificationprocess and determine the contact classification, as more fullydescribed herein, with the frame data being classified, for example, bydetecting patterns in the frame data of the frame image 2000. However,it is to be appreciated and understood that, in some instances, thepattern classification of the frame data of the frame image 2000 may notyield results that have a high confidence level. Accordingly, the objectclassification component 112 can apply the subdivision analysis (atreference numeral 1304 of the method 1300). In this example case, suchsubdivision analysis can enhance the determination of the contactclassification, and can assist to make a higher confidence determinationof the contact classification such as, for example, a determination(e.g., a higher confidence determination) as to whether contacts 2002and/or 2004 are knuckle contacts or fingertip contacts associated with afinger(s) of the user, based at least in part on the subdivisionanalysis described herein. Similarly, a determination (e.g., a higherconfidence determination) can be made (e.g., by the objectclassification component 112) as to whether the contact 2006 is afingernail contact of a fingernail of the finger of the user, a styluscontact of a stylus, or another contact of another object, with thetouch sensitive surface 104 based at least in part on the subdivisionanalyses described herein.

It is to be appreciated and understood from this disclosed subjectmatter that using the techniques described herein, touch sensitivedevices can be provided with improved ability to interpret patterns ofcontact or association (e.g., hovering) of an object with respect to atouch sensitive surface.

It also is to be appreciated and understood that the ordering of and thenumber of method acts or operations can be changed within the spirit andscope of the disclosed subject matter.

FIG. 21 illustrates an example of this. FIG. 21 illustrates a flowdiagram of another example method 2100 for classifying contacts ofobjects with or in proximity to the touch sensitive surface 104 of thetouch sensitive device 1100, in accordance with various aspects andembodiments of the disclosed subject matter. At reference numeral 2102,frame data can be received. For instance, the object classificationcomponent 112 can receive or generate frame data, wherein the frame datacan comprise or be generated based at least in part on sensor data(e.g., touch surface data or other sensor data) generated from sensingthe touch sensitive surface 104.

At reference numeral 2104, a subdivision analysis can be performed(e.g., executed) on the frame data. The object classification component112 can perform the subdivision analysis on the frame data, wherein theobject classification component 112 can divide a frame image comprisingor representing the frame data into a pattern of bounding areas, whereinrespective portions of the frame data are distributed among therespective bounding areas, as more fully described herein. The objectclassification component 112 can analyze the subdivisions andrespectively associated portions of the frame data.

For instance, as is generally described herein, as part of thesubdivision analysis, the object classification component 112 candetermine (e.g., identify, or compute) a number of descriptive featuresfor each subdivision. The object classification component 112 candetermine these descriptive features, for example, by analysis of therespective portions of the frame data within the respectivesubdivisions. Examples of the analyses can include the analysesdescribed herein (e.g., with respect to the method 1300) and can, forexample, include determining (e.g., by the object classificationcomponent 112) high intensities, such as a maximum intensity, or lowintensities within a subdivision, a size or shape of the areas ofintensities within a subdivision, a standard deviation of intensitieswithin a subdivision, or any other information that can be determinedbased at least in part the results of analyzing the portion of framedata within a subdivision. Additionally, the object classificationcomponent 112 can determine and use characteristics of one or moresubdivisions adjacent to or otherwise proximate to a subdivision beinganalyzed to determine (e.g., compute) descriptive features for thatsubdivision.

At reference numeral 2106, a contact classification regarding contact orassociation of an object with the touch sensitive surface 104 can bedetermined based at least in part on the results of the subdivisionanalysis. The object classification component 112 can determine one ormore the contact classification regarding the contact or association ofthe object with the touch sensitive surface 104 based at least in parton the results of the subdivision analysis. For instance, the objectclassification component 112 can determine the contact classificationbased at least in part on the respective descriptive features determinedfor the respective subdivisions associated with the frame data. Forexample, in some instances, based at least in part on the results of thesubdivision analysis, the object classification subdivision analysis canidentify descriptive features for a particular subdivision that canindicate that the particular subdivision of the frame data appears torepresent an ear lobe of an ear of the user.

As part of the contact classification determination, the objectclassification component 112 can determine whether that particularsubdivision is located at or proximate to a bottom of one or moresubdivisions that form a larger contact area that may appear to be partof a mid-portion of an ear of the user, when the ear is in contact withthe touch sensitive surface 104. If the object classification component112 determines that the particular subdivision is at or proximate to thebottom of one or more subdivisions that form a larger contact (orassociation) area that appears to be part of the mid-portion of the earof the user, the object classification component 112 can determine thatthe particular subdivision is associated with the ear lobe of the userand/or can determine the contact classification for the contact orassociation (e.g., hover) of the object with the touch sensitive surface104 to be an ear or head contact or association. In contrast, if theparticular subdivision appears to be an ear lobe, but further appears tobe in the middle of a contact area, as part of the contactclassification determination, the object classification component 112can or may determine that such contact or association with respect tothat particular subdivision is not representative of the ear of theuser.

It will be understood from above that in either of the embodimentsillustrated in FIG. 13 or in FIG. 21, the methods 1300 and 2100, and theobject classification component 112, can utilize any or all of thedescriptive features determined for a subdivision of the frame data, thelocation of the subdivision, and the shape of the subdivision, as wellas frame data and descriptive features associated with subdivisions thatare adjacent to or proximate to the subdivision being analyzed in orderto improve any or all of the reliability, speed, and/or efficiency ofthe process.

In some embodiments, at reference numeral 2108, the contactclassification can be (e.g., optionally can be) subject to confidencetesting to determine whether there is adequate confidence in the contactclassification determination. The object classification component 112can evaluate the contact classification by performing confidence testingof the contact classification to determine whether there is sufficientconfidence in the contact classification, in accordance with the definedclassification criteria. For instance, the object classificationcomponent 112 can determine and produce a classification confidencelevel for the contact classification and can determine whether thatclassification confidence level satisfies the defined classificationcriteria (e.g., satisfies a defined threshold confidence level).

In certain embodiments, to yield more robust and desirable behavior, theevent determination component 114, the processor 1110, or othercomponent(s) of the touch sensitive device 1100 can control switching ofa mode(s) of operation of the touch sensitive device 1100 (e.g., amode(s) of the touch sensitive surface 104 and/or a mode(s) of thedisplay screen 1104) such that a mode(s) of the touch sensitive device100 can be (e.g., only will be) switched (e.g., from one mode to anothermode) when it is determined (e.g., by the object classificationcomponent 112 or other component) that the confidence level of thecontact classification satisfies a defined threshold confidence level(e.g., defined threshold high confidence level) to indicate that theconfidence level in the contact classification is sufficiently high.

In some embodiments, the object classification component 112 (or eventdetermination component 114) can determine or evaluate (e.g., optionallycan determine or evaluate) a confidence level of a particular contactclassification by comparing the particular contact classification to oneor more alternate contact classifications determined by the objectclassification component 112. The object classification component 112can determine such alternate classifications in any of a number of waysand using any of a number of alternative contact classification methodsor techniques, such as, for example, contact classification usingpattern analysis, as described herein, or a next best classificationthat can be determined using the descriptive features determined fromthe subdivisions during subdivision analysis.

It is to be appreciated and understood that, in instances where this isdone, the object classification component 112, the consistencydetermining act of reference numeral 1306 of the method 1300 of FIG. 13,and/or the contact classification confidence determination of referencenumeral 2108 of the method 2100 of FIG. 21 can make use of thecombination of features that can be determined (e.g., by the objectclassification component 112) during subdivision analysis of frame dataas well as location information associated with the subdivisions.Furthermore, the object classification component 112 can utilize shapeinformation regarding the shape of any subdivision of the subdivisionsin connection with the subdivision analysis to facilitate determiningthe contact classification. Further, in some embodiments, the objectclassification component 112 can determine a confidence level for acontact classification with respect to frame data, in part, bydetermining (e.g., calculating) a confidence metric for use inconnection with a contact classification determination, and determininga confidence level for the contact classification based at least in parton this confidence metric, in accordance with the defined classificationcriteria.

With further regard to the method 2100 of FIG. 21, at reference numeral2110, a contact classification (e.g., a frame contact classification)can be compared with previous contact classification determinations todetermine a current contact state of an object 1108 with respect to thetouch sensitive surface 104. In accordance with reference numeral 2110of the method 2100, the object classification component 112 or the eventdetermination component 114 can compare a contact classification withprevious contact classification determinations to determine a currentcontact state of an object 1108 with respect to the touch sensitivesurface 104, as more fully described herein.

At reference numeral 2112, an event can be determined, based at least inpart on the current contact state associated with the touch sensitivesurface 104. For instance, the event determination component 114 canutilize the current contact state relating to contact (or no contact) orassociation (e.g., hovering) of an object 1108 with respect to the touchsensitive surface 104 (and/or associated display screen 1104) todetermine an event, based at least in part on the current contact stateassociated with the touch sensitive surface 104. The event can be anaction (e.g., a response action) that can be performed by the eventdetermination component 114, the processor 1110, the touch sensitivesurface 104, the touch sensing system 102, the display screen 1104, thedisplay system 1102, or another component of the touch sensitive device1100, as appropriate. Depending in part on the contact classification,the event can comprise, for example, enabling a touch function(s) of thetouch sensitive surface 104 (or associated display screen 1104),disabling a touch function(s) of the touch sensitive surface 104 (orassociated display screen 1104), turning the display screen 1104, or aportion of the display screen 1104, on, or turning the display screen1104, or a portion of the display screen 1104, off.

At reference numeral 2114, the method 2100 can terminate, or the method2100 can continue by proceeding to reference numeral 2102 to receivefurther frame data and proceed from that point.

FIG. 22 depicts a flow diagram of an example method 2200 for classifyingcontacts of objects with or in proximity to a touch sensitive surface104 of a touch sensitive device (e.g., 100, 1100) based at least in parton touch surface data associated with the touch sensitive surface 104and motion data associated with the touch sensitive device, inaccordance with various aspects and embodiments of the disclosed subjectmatter.

At reference numeral 2202, touch surface data associated with the touchsensitive surface 104 can be received. The object classificationcomponent 112 can receive the touch surface data (e.g., touchsurface-related sensor data) from one or more surface-related sensors108 of the sensor component 106, wherein the one or more surface-relatedsensors 108 can be associated with the touch sensitive surface 104. Insome embodiments, the touch surface data can comprise capacitive dataobtained from capacitive sensors of the sensor component 106.

At reference numeral 2204, motion data associated with the touchsensitive device can be received. The object classification component112 can receive the motion data associated with the touch sensitivedevice from one or more motion-related sensors 110 of the sensorcomponent 106, wherein the motion data can relate to motion of the touchsensitive device. The motion data can comprise respective portions ofthe motion data associated with one or more respective axes and/or oneor more respective motion-related sensors 110. The motion-relatedsensors 110 can comprise an accelerometer (e.g., a three-axisaccelerometer), a gyroscope (e.g., a three-axis gyroscope, and/or an IMU(e.g., a multi-axis IMU).

At reference numeral 2206, the touch surface data and the motion datacan be analyzed. The object classification component 112 can analyze thetouch surface data and the motion data to facilitate determining acontact classification with respect to an object (e.g., one or moreobject items) that can be in contact with or associated with (e.g.,hovering in proximity to) the touch sensitive surface 104 of the touchsensitive device.

In some embodiments, the object classification component 112 can analyzethe touch surface data separately from analyzing the motion data. Forexample, the object classification component 112 can analyze the touchsurface data to facilitate determining an initial or preliminary contactclassification for an object with respect to the touch sensitive surface104. The object classification component 112 also can analyze (e.g., viaa separate analysis) the motion data to facilitate determining anotherpreliminary contact classification for an object with respect to thetouch sensitive surface 104. Such other preliminary contactclassification can be used by the object classification component 112 tofacilitate determining whether the initial or preliminary contactclassification is consistent with the other preliminary contactclassification, determining or evaluating a confidence level in theaccuracy of the initial or preliminary contact classification, and/orenhancing the accuracy of the contact classification for an object withrespect to the touch sensitive surface 104.

In accordance with various implementations, as part of the analysis ofthe touch surface data, the object classification component 112 cangenerate frame data from the touch surface data, extract features fromthe frame data, generate a frame image based at least in part on theframe data, perform a subdivision analysis on the frame data or featuresextracted from the frame data, and/or perform a pattern analysis on apattern determined based at least in part on the frame data or features(e.g., pattern features) extracted from the frame data, as more fullydescribed herein, wherein the extracted features can be indicative of atype or classification of an object (e.g., one or more object items). Inaccordance with various other implementations, as part of the analysisof the motion data, the object classification component 112 can extractfeatures from the motion data, perform an analysis on the extractedfeatures, and/or perform a pattern analysis on a pattern determinedbased at least in part on the motion data or extracted features, as morefully described herein, wherein the extracted features can be indicativeof a type or classification of an object (e.g., one or more objectitems) with respect to contact or association of the object with thetouch sensitive surface 104. The features can comprise, for example,characteristics, shapes, dimensions, spectral centroid, spectraldensity, spherical harmonics, total average spectral energy, and/or logspectral band ratios related to the contact or association of theobject(s) with the touch sensitive surface 104, with respect to the timedomain or frequency domain, respectively.

In other embodiments, the object classification component 112 cananalyze the touch surface data and the motion data in a combinedanalysis to facilitate determining the contact classification for anobject with respect to the touch sensitive surface 104, determining aconfidence level in the accuracy of the contact classification, and/orenhancing the accuracy of the contact classification for an object withrespect to the touch sensitive surface 104.

At reference numeral 2208, a contact classification for an object withrespect to the touch sensitive surface 104 can be determined based atleast in part on the results of analyzing the touch surface data and themotion data, in accordance with the defined classification criteria. Theobject classification component 112 can determine the contactclassification for the object with respect to the touch sensitivesurface 104 based at least in part on the results of analyzing the touchsurface data and the motion data, in accordance with the definedclassification criteria, as more fully described herein.

The contact classification be one of a set of contact classificationsthat can comprise, for example, a no touch state, a head state, a fingerstate, a head-hovering state, and a finger-hovering state. The no touchstate can indicate that an object is not in contact with and is nothovering in proximity to the touch sensitive surface 104. The head statecan indicate that the object is a face, a head, and/or an ear of a user,and such object is in contact with the touch sensitive surface 104. Thefinger state can indicate that the object is a finger or a hand of theuser, and that object is in contact with the touch sensitive surface104. The head-hovering state can indicate that the object is the face,the head, and/or the ear of the user, and such object is hovering overand in proximity to the touch sensitive surface 104 and is not incontact with the touch sensitive surface 104. The finger-hovering statecan indicate that the object is the finger or the hand of the user, andthat object is hovering over and in proximity to the touch sensitivesurface 104 and is not in contact with the touch sensitive surface 104.

At reference numeral 2210, an action to be performed can be determinedbased at least in part on the contact classification. The eventdetermination component 114 can determine the action (e.g., an event orresponsive action) that can be performed based at least in part on(e.g., in response to the determination of) the contact classification.

At reference numeral 2212, the action can be performed. The eventdetermination component 114 can facilitate the performance of the actionto facilitate enhanced (e.g., improved or optimal) control of operationof the touch sensitive surface 104, display screen 1104, or anothercomponent of the touch sensitive device. Depending in part on theparticular action to be performed, the event determination component114, the processor 1110, the touch sensitive surface 104, the touchsensing system 102, the display screen 1104, the display system 1102,and/or another component of the touch sensitive device can performrespective operations to perform the action. Depending in part on thecontact classification, the action can comprise, for example, enabling atouch function(s) of the touch sensitive surface 104 (or associateddisplay screen 1104), disabling a touch function(s) of the touchsensitive surface 104 (or associated display screen 1104), turning thedisplay screen 1104, or a portion of the display screen 1104, on, orturning the display screen 1104, or a portion of the display screen1104, off.

FIG. 23 illustrates a flow diagram of another example method 2300 forclassifying contacts of objects with or in proximity to a touchsensitive surface 104 of a touch sensitive device (e.g., 100, 1100)based at least in part on touch surface data associated with the touchsensitive surface 104 and motion data associated with the touchsensitive device, in accordance with various aspects and embodiments ofthe disclosed subject matter.

At reference numeral 2302, touch surface data associated with the touchsensitive surface 104 and motion data relating to motion of the touchsensitive device can be analyzed. The object classification component112 can receive the touch surface data and the motion data fromrespective sensors of the sensor component 106, as more fully describedherein. The object classification component 112 can analyze the touchsurface data and the motion data to facilitate determining or extractingrespective features from the touch surface data and the motion data, inconnection with determining a contact classification with respect to acontact or association of an object with the touch sensitive surface104.

At reference numeral 2304, first features relating to the touch surfacedata can be determined based at least in part on the results ofanalyzing the touch surface data. At reference numeral 2306, secondfeatures relating to the motion data can be determined based at least inpart on the results of analyzing the motion data. The objectclassification component 112 can determine the first features and thesecond features based at least in part on the results of analyzing thetouch surface data and the motion data.

The first features and second features can be utilized in respectivepattern analyses to facilitate determining a contact classification withrespect to an object (e.g., one or more object items) that can be incontact with or associated with (e.g., hovering in proximity to) thetouch sensitive surface 104 of the touch sensitive device. Therespective features can be indicative of a type or classification of anobject (e.g., one or more object items) with respect to contact orassociation of the object with the touch sensitive surface 104. Therespective features can comprise, for example, characteristics, shapes,dimensions, spectral centroid, spectral density, spherical harmonics,total average spectral energy, and/or log spectral band ratios relatedto the contact or association of the object(s) with the touch sensitivesurface 104, with respect to the time domain or frequency domain, asapplicable, respectively.

In some implementations, as part of the analysis of the touch surfacedata, the object classification component 112 can generate frame datafrom the touch surface data, generate a frame image based at least inpart on the frame data, and/or perform a subdivision analysis on theframe data or features determined or extracted from the touch surfacedata or frame data, as more fully described herein. In accordance withvarious other implementations, as part of the analysis of the touchsurface data and/or the motion data, the object classification component112 can employ an FFT or a similar function to convert (e.g., transform)the touch surface data, the motion data, or other data (e.g., framedata) from a time domain representation of such data to a frequencydomain representation of such data to facilitate efficient analysis ofsuch data.

At reference numeral 2308, a first pattern analysis can be performed, inpart, by comparing a touch-surface-related pattern formed or representedby the first features to other touch-surface-related patterns that arerespectively associated with respective contact classifications. Theobject classification component 112 can employ one or more patternrecognition techniques to facilitate performing the first patternanalysis with respect to the touch-surface-related pattern. Forinstance, as part of the first pattern analysis, the objectclassification component 112 can compare the touch-surface-relatedpattern associated with the first features to other respectivetouch-surface-related patterns that can be associated with respectivecontact classifications to facilitate determining which pattern(s) ofthe other touch-surface-related patterns most closely or sufficientlyclosely matches the touch-surface-related pattern. Such first patternanalysis can facilitate determining the contact classification withrespect to a contact or association of the object with the touchsensitive surface 104.

At reference numeral 2310, a second pattern analysis can be performed,in part, by comparing a motion-related pattern formed or represented bythe second features to other motion-related patterns that arerespectively associated with respective contact classifications. Theobject classification component 112 can employ one or more patternrecognition techniques to facilitate performing the second patternanalysis with respect to the motion-related pattern. For example, aspart of the second pattern analysis, the object classification component112 can compare the motion-related pattern associated with the secondfeatures to other respective motion-related patterns that can beassociated with respective contact classifications to facilitatedetermining which pattern(s) of the other motion-related patterns mostclosely or sufficiently closely matches the motion-related pattern. Suchsecond pattern analysis also can facilitate determining the contactclassification with respect to the contact or association of the objectwith the touch sensitive surface 104.

At reference numeral 2312, a contact classification, with respect to acontact or association of an object with the touch sensitive surface104, can be determined based at least in part on the results of thefirst pattern analysis and/or the second pattern analysis. The objectclassification component 112 can determine the contact classificationwith respect to the contact or association of the object with the touchsensitive surface 104 based at least in part on the results of the firstpattern analysis and/or the second pattern analysis.

For example, if the result of the first pattern analysis indicates thatthe object is a finger of the user in contact with (or in proximity to)the touch sensitive surface 104, and the result of the second patternanalysis indicates that the object is the finger of the user in contactwith (or in proximity to) the touch sensitive surface 104, the objectclassification component can determine that contact classification is afinger contact (or a finger-hover). As another example, if the result ofthe first pattern analysis indicates that the object is a head (e.g.,ear) of the user in contact with (or in proximity to) the touchsensitive surface 104, and the result of the second pattern analysisindicates that the object is the head of the user in contact with (or inproximity to) the touch sensitive surface 104, the object classificationcomponent 112 can determine that contact classification is a headcontact (or a head-hover).

As still another example, if the result of the first pattern analysisindicates a first type of contact or association of the object (e.g.,head of the user) with respect to the touch sensitive surface 104, andthe result of the second pattern analysis indicates a second type ofcontact or association of the object (e.g., finger of the user) withrespect to the touch sensitive surface 104, the object classificationcomponent 112 can determine that a contact classification is notsufficiently clear, and can determine that further data analysis is tobe performed using subsequent (e.g., next) touch surface data and motiondata or previous touch surface data and motion data (e.g., previouscontact classifications determined using such previous data) tofacilitate determining the contact classification.

As yet another example, if the result of the first pattern analysisindicates a first type of contact of the object (e.g., head of the user)with respect to the touch sensitive surface 104, and the result of thesecond pattern analysis indicates a first type of association of theobject (e.g., head-hover of the user) with respect to the touchsensitive surface 104, in accordance with various implementations, theobject classification component 112 can determine that the contactclassification a head-related contact classification (e.g., head contactor head hover) or can determine that the contact classification is notsufficiently clear, depending in part on the applicable classificationcriteria. For instance, with regard to certain potentially applicableclassification criteria related to some instances, it may be sufficientto classify the contact as a head contact or head hover in order todetermine an action (e.g., event or response action) to be performed bythe event determination component 114, wherein, the action can comprise,for example, a disabling of a touch function associated with the touchsensitive surface 104 and/or a switching off of the display screen 1104.

However, with regard to other potentially applicable classificationcriteria related to other instances, it may not be sufficient toclassify the contact as a head contact or head hover in order todetermine an action to be performed by the event determination component114, and a more precise contact classification may be desirable. In suchinstances, the object classification component 112 can determine thatfurther data analysis is to be performed using subsequent touch surfacedata and motion data or previous touch surface data and motion data tofacilitate determining the contact classification with respect to theobject (if any) and the touch sensitive surface 104.

In some embodiments, the object classification component 112 can utilizeprevious (e.g., relatively recent) or historical contact classificationswith respect to object contacts or associations with the touch sensitivesurface 104 (whether determined based on the method 2300 or anothermethod(s) or technique(s), such as disclosed herein) to facilitatedetermining the contact classification with respect to the object (ifany) and the touch sensitive surface 104.

In certain embodiments, the object classification component 112 candetermine a contact classification for a contact or association (e.g.,hover) of an object with respect to the touch sensitive surface 104,based at least in part on the results of analyzing the touch surfacedata and/or the motion data (e.g., raw or substantially raw touchsurface data and/or motion data), without having to perform a patternanalysis (or subdivision analysis).

The aforementioned systems and/or devices have been described withrespect to interaction between several components. It should beappreciated that such systems and components can include thosecomponents or sub-components specified therein, some of the specifiedcomponents or sub-components, and/or additional components.Sub-components could also be implemented as components communicativelycoupled to other components rather than included within parentcomponents. Further yet, one or more components and/or sub-componentsmay be combined into a single component providing aggregatefunctionality. The components may also interact with one or more othercomponents not specifically described herein for the sake of brevity,but known by those of skill in the art.

With regard to the methods and/or flow diagrams described herein, forsimplicity of explanation, the methods have been depicted and describedas a series of acts. It is to be understood and appreciated that thedisclosed subject matter is not limited by the acts illustrated and/orby the order of acts, for example acts can occur in various ordersand/or concurrently, and with other acts not presented and describedherein. Furthermore, not all illustrated acts may be required toimplement the methods in accordance with the disclosed subject matter.In addition, those skilled in the art will understand and appreciatethat the methods could alternatively be represented as a series ofinterrelated states via a state diagram or events. Additionally, itshould be further appreciated that the methods disclosed herein andthroughout this specification are capable of being stored on an articleof manufacture to facilitate transporting and transferring such methodsto computers. The term article of manufacture, as used herein, isintended to encompass a computer program accessible from anycomputer-readable device or storage media.

While the subject matter has been described above in the general contextof computer-executable instructions of a computer program that runs on acomputer and/or computers, those skilled in the art will recognize thatthis disclosure also can or may be implemented in combination with otherprogram modules. Generally, program modules include routines, programs,components, data structures, etc. that perform particular tasks and/orimplement particular abstract data types. Moreover, those skilled in theart will appreciate that the disclosed methods may be practiced withother computer system configurations, including single-processor ormultiprocessor computer systems, mini-computing devices, mainframecomputers, as well as personal computers, hand-held computing devices(e.g., PDA, phone), microprocessor-based or programmable consumer orindustrial electronics, and the like. The illustrated aspects may alsobe practiced in distributed computing environments where tasks areperformed by remote processing devices that are linked through acommunications network. However, some, if not all aspects of thisdisclosure can be practiced on stand-alone computers. In a distributedcomputing environment, program modules may be located in both local andremote memory storage devices.

As used in this application, the terms “component,” “system,”“platform,” “interface,” “unit,” and the like, can refer to and/or caninclude a computer-related entity or an entity related to an operationalmachine with one or more specific functionalities. The entitiesdisclosed herein can be either hardware, a combination of hardware andsoftware, software, or software in execution. For example, a componentmay be, but is not limited to being, a process running on a processor, aprocessor, an object, an executable, a thread of execution, a program,and/or a computer. By way of illustration, both an application runningon a server and the server can be a component. One or more componentsmay reside within a process and/or thread of execution and a componentmay be localized on one computer and/or distributed between two or morecomputers.

In another example, respective components can execute from variouscomputer readable media having various data structures stored thereon.The components may communicate via local and/or remote processes such asin accordance with a signal having one or more data packets (e.g., datafrom one component interacting with another component in a local system,distributed system, and/or across a network such as the Internet withother systems via the signal). As another example, a component can be anapparatus with specific functionality provided by mechanical partsoperated by electric or electronic circuitry, which is operated by asoftware or firmware application executed by a processor. In such acase, the processor can be internal or external to the apparatus and canexecute at least a part of the software or firmware application. As yetanother example, a component can be an apparatus that provides specificfunctionality through electronic components without mechanical parts,wherein the electronic components can include a processor or other meansto execute software or firmware that confers at least in part thefunctionality of the electronic components. In an aspect, a componentcan emulate an electronic component via a virtual machine, e.g., withina cloud computing system.

In addition, the term “or” is intended to mean an inclusive “or” ratherthan an exclusive “or.” That is, unless specified otherwise, or clearfrom context, “X employs A or B” is intended to mean any of the naturalinclusive permutations. That is, if X employs A; X employs B; or Xemploys both A and B, then “X employs A or B” is satisfied under any ofthe foregoing instances. Moreover, articles “a” and “an” as used in thesubject specification and annexed drawings should generally be construedto mean “one or more” unless specified otherwise or clear from contextto be directed to a singular form.

As used herein, the terms “example” and/or “exemplary” are utilized tomean serving as an example, instance, or illustration. For the avoidanceof doubt, the subject matter disclosed herein is not limited by suchexamples. In addition, any aspect or design described herein as an“example” and/or “exemplary” is not necessarily to be construed aspreferred or advantageous over other aspects or designs, nor is it meantto preclude equivalent exemplary structures and techniques known tothose of ordinary skill in the art.

Various aspects or features described herein can be implemented as amethod, apparatus, system, or article of manufacture using standardprogramming or engineering techniques. In addition, various aspects orfeatures disclosed in this disclosure can be realized through programmodules that implement at least one or more of the methods disclosedherein, the program modules being stored in a memory and executed by atleast a processor. Other combinations of hardware and software orhardware and firmware can enable or implement aspects described herein,including a disclosed method(s). The term “article of manufacture” asused herein can encompass a computer program accessible from anycomputer-readable device, carrier, or storage media. For example,computer readable storage media can include but are not limited tomagnetic storage devices (e.g., hard disk, floppy disk, magnetic strips. . . ), optical discs (e.g., compact disc (CD), digital versatile disc(DVD), blu-ray disc (BD) . . . ), smart cards, and flash memory devices(e.g., card, stick, key drive . . . ), or the like.

As it is employed in the subject specification, the term “processor” canrefer to substantially any computing processing unit or devicecomprising, but not limited to, single-core processors;single-processors with software multithread execution capability;multi-core processors; multi-core processors with software multithreadexecution capability; multi-core processors with hardware multithreadtechnology; parallel platforms; and parallel platforms with distributedshared memory. Additionally, a processor can refer to an integratedcircuit, an application specific integrated circuit (ASIC), a digitalsignal processor (DSP), a field programmable gate array (FPGA), aprogrammable logic controller (PLC), a complex programmable logic device(CPLD), a discrete gate or transistor logic, discrete hardwarecomponents, or any combination thereof designed to perform the functionsdescribed herein. Further, processors can exploit nano-scalearchitectures such as, but not limited to, molecular and quantum-dotbased transistors, switches and gates, in order to optimize space usageor enhance performance of user equipment. A processor may also beimplemented as a combination of computing processing units.

In this disclosure, terms such as “store,” “storage,” “data store,” datastorage,” “database,” and substantially any other information storagecomponent relevant to operation and functionality of a component areutilized to refer to “memory components,” entities embodied in a“memory,” or components comprising a memory. It is to be appreciatedthat memory and/or memory components described herein can be eithervolatile memory or nonvolatile memory, or can include both volatile andnonvolatile memory.

By way of illustration, and not limitation, nonvolatile memory caninclude read only memory (ROM), programmable ROM (PROM), electricallyprogrammable ROM (EPROM), electrically erasable ROM (EEPROM), flashmemory, or nonvolatile random access memory (RAM) (e.g., ferroelectricRAM (FeRAM)). Volatile memory can include RAM, which can act as externalcache memory, for example. By way of illustration and not limitation,RAM is available in many forms such as synchronous RAM (SRAM), dynamicRAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), direct RambusRAM (DRRAM), direct Rambus dynamic RAM (DRDRAM), and Rambus dynamic RAM(RDRAM). Additionally, the disclosed memory components of systems ormethods herein are intended to include, without being limited toincluding, these and any other suitable types of memory.

It is to be appreciated and understood that components, as describedwith regard to a particular system or method, can include the same orsimilar functionality as respective components (e.g., respectively namedcomponents or similarly named components) as described with regard toother systems or methods disclosed herein.

What has been described above includes examples of systems and methodsthat provide advantages of this disclosure. It is, of course, notpossible to describe every conceivable combination of components ormethods for purposes of describing this disclosure, but one of ordinaryskill in the art may recognize that many further combinations andpermutations of this disclosure are possible. Furthermore, to the extentthat the terms “includes,” “has,” “possesses,” and the like are used inthe detailed description, claims, appendices and drawings such terms areintended to be inclusive in a manner similar to the term “comprising” as“comprising” is interpreted when employed as a transitional word in aclaim.

What is claimed is:
 1. A method, comprising: analyzing, by a systemcomprising a processor, characteristics of touch screen data associatedwith a touch sensitive surface that is associated with a device and aportion of motion data of at least one axis associated with the device,wherein a first amount of the motion data and a number of axes of themotion data to be included in the portion of the motion data isdetermined based at least in part on at least one of a second amount oftime available to perform the analyzing, a third amount of resourcesavailable to perform the analyzing, or a confidence level that isassociated with a preliminary contact classification for an object withrespect to the touch sensitive surface and determined based at least inpart on a preliminary analysis result of analyzing the touch screendata; and based at least in part on at least one result of theanalyzing, determining, by the system, a contact classification for theobject with respect to the touch sensitive surface to determine acontact state of the object in relation to the touch sensitive surface.2. The method of claim 1, wherein the touch screen data comprises atleast one of contact data or capacitive data, wherein, when the touchscreen data comprises the contact data, the contact data indicateswhether the object is in contact or is not in contact with the touchsensitive surface, and wherein, when the touch screen data comprises thecapacitive data, the capacitive data indicates whether the object is incontact with the touch sensitive surface, is not in contact with thetouch sensitive surface, is hovering within a defined distance of thetouch sensitive surface resulting in a change in a capacitance valueassociated with the touch sensitive surface, or is not hovering withinthe defined distance of the touch sensitive surface.
 3. The method ofclaim 1, wherein there is a set of contact classifications, comprisingthe contact classification, relating to the contact state of the objectin relation to the touch sensitive surface, wherein the set of contactclassifications comprise a no touch state, a head state, a finger state,a head-hovering state, and a finger-hovering state, wherein the no touchstate indicates the object is not in contact with and is not hovering inproximity to the touch sensitive surface, the head state indicates thatthe object is a face, a head, or an ear of a user and is in contact withthe touch sensitive surface, the finger state indicates that the objectis a finger or a hand of the user and is in contact with the touchsensitive surface, the head-hovering state indicates that the object isthe face, the head, or the ear of the user and is hovering over thetouch sensitive surface in proximity to the touch sensitive surface andis not in contact with the touch sensitive surface, and thefinger-hovering state indicates that the object is the finger or thehand of the user and is hovering over the touch sensitive surface inproximity to the touch sensitive surface and is not in contact with thetouch sensitive surface.
 4. The method of claim 1, wherein the motiondata comprises at least one of vibro-acoustic data associated with thedevice, inertial measurement unit data associated with the device,accelerometer data associated with the device, gyroscope data associatedwith the device, acceleration data indicating an acceleration of thedevice, velocity data indicating a velocity of the device, angular ratedata indicating an angular rate of the device, position data indicatinga position or a change in position of the device, or orientation dataindicating an orientation or a change in orientation of the device. 5.The method of claim 1, wherein the motion data of the at least one axisassociated with the device comprises motion data of two or more axesassociated with one or more sources of the motion data.
 6. The method ofclaim 1, further comprising receiving, by the system, the motion datafrom at least one of an accelerometer, a gyroscope, an inertialmeasurement unit, or a sensor.
 7. The method of claim 1, furthercomprising determining whether the object is in contact with the touchsensitive surface or whether the object is hovering in proximity to thetouch sensitive surface based at least in part on the at least oneresult of the analyzing.
 8. The method of claim 1, further comprisingcontrolling, by the system, a display function associated with the touchsensitive surface based at least in part on the contact classificationfor the object, wherein the display function comprises enabling a touchsensitive function of the touch sensitive surface of a display screen ofthe device, disabling the touch sensitive function of the touchsensitive surface, switching the display screen to an on state, orswitching the display screen to an off state.
 9. The method of claim 1,further comprising determining, by the system, one or more descriptivefeatures that are indicative of the object for at least one subdivisionof subdivisions associated with at least one of the touch screen data orthe motion data, based at least in part on the at least one result ofthe analyzing.
 10. The method of claim 9, wherein the determining thecontact classification comprises determining the contact classificationfor the object in contact with the touch sensitive surface based atleast in part on the one or more descriptive features, at least onelocation of the at least one subdivision, and the motion data.
 11. Themethod of claim 9, further comprising: generating, by the system, framedata representative of an image indicating one or more respectivelocations of contact or hovering of one or more respective portions ofthe object with the touch sensitive surface based at least in part on atleast one of the touch screen data or the motion data; and dividing, bythe system, the frame data into respective portions of the frame data togenerate respective subdivisions of the subdivisions, wherein therespective subdivisions comprise the at least one subdivision, whereinthe at least one subdivision comprises a first subdivision associatedwith a first portion of the frame data and a second subdivisionassociated with a second portion of the frame data, wherein the firstsubdivision partially overlaps the second subdivision, and wherein theanalyzing comprises analyzing the respective subdivisions to determinerespective descriptive features of the respective subdivisions.
 12. Themethod of claim 11, further comprising: converting, by the system, theframe data into a frequency domain representation, wherein thesubdivisions are defined in the frequency domain representation;extracting, by the system, at least one of a spectral centroid, aspectral density, spherical harmonics, a total average spectral energy,or log spectral band ratios based at least in part on the frequencydomain representation; and based at least in part on the extracting,classifying, by the system, one or more respective contacts within oneor more respective subdivisions of the subdivisions of the touchsensitive surface.
 13. The method of claim 1, further comprising:comparing, by the system, the contact classification for the object withprevious contact classifications; and determining, by the system, thecontact state of the object with the touch sensitive surface based atleast in part on a comparison result of the comparing.
 14. A system,comprising: a memory that stores executable components; and a processor,operatively coupled to the memory, that executes the executablecomponents, the executable components comprising: an objectclassification component configured to analyze touch surface informationassociated with a touch sensitive surface that is associated with adevice and a portion of motion information of at least one axisassociated with the device, wherein the object classification componentis further configured to determine a contact classification for anobject with respect to the touch sensitive surface, based at least inpart on at least one result of the analyzing, to determine a contactstate of the object with respect to the touch sensitive surface, andwherein a number of axes of the motion information to be included in theportion of the motion information is determined based at least in parton at least one of a first amount of time available to perform theanalysis, a second amount of processing resources available to performthe analysis, or a confidence value that is associated with apreliminary contact classification for the object with respect to thetouch sensitive surface and determined based at least in part on anintermediate analysis result of analyzing the touch surface information.15. The system of claim 14, wherein the touch surface informationcomprises at least one of contact information or capacitive information,wherein the contact information indicates whether the object is incontact or is not in contact with the touch sensitive surface, andwherein the capacitive information indicates whether the object is incontact with the touch sensitive surface, is not in contact with thetouch sensitive surface, is hovering in proximity to the touch sensitivesurface resulting in a change in an amount of capacitance associatedwith the touch sensitive surface, or is not hovering in proximity to thetouch sensitive surface.
 16. The system of claim 14, wherein there is aset of contact classifications, comprising the contact classification,relating to the contact state of the object with respect to the touchsensitive surface, wherein the set of contact classifications comprise ano touch state, a head state, a finger state, a head-hovering state, anda finger-hovering state, wherein the no touch state indicates the objectis not in contact with and is not hovering in proximity to the touchsensitive surface, the head state indicates that the object is a face, ahead, or an ear of a user and is in contact with the touch sensitivesurface, the finger state indicates that the object is a finger or ahand of the user and is in contact with the touch sensitive surface, thehead-hovering state indicates that the object is the face, the head, orthe ear of the user and is hovering over the touch sensitive surface inproximity to the touch sensitive surface and is not in contact with thetouch sensitive surface, and the finger-hovering state indicates thatthe object is the finger or the hand of the user and is hovering overthe touch sensitive surface in proximity to the touch sensitive surfaceand is not in contact with the touch sensitive surface.
 17. The systemof claim 14, wherein the motion information comprises at least one ofvibro-acoustic information associated with the device, inertialmeasurement unit information associated with the device, accelerometerinformation associated with the device, gyroscope information associatedwith the device, acceleration information indicating an acceleration ofthe device, velocity information indicating a velocity of the device,angular rate information indicating an angular rate of the device,position information indicating a position or a change in position ofthe device, or orientation information indicating an orientation or achange in orientation of the device.
 18. The system of claim 14, whereinthe motion information of the at least one axis associated with thedevice comprises motion information of two or more axes associated withone or more sources of the motion information.
 19. The system of claim14, wherein the object classification component receives the motioninformation from at least one of an accelerometer, a gyroscope, aninertial measurement unit, or a sensor.
 20. The system of claim 14,wherein the executable components further comprise an eventdetermination component configured to control a display functionassociated with the touch sensitive surface based at least in part onthe contact classification for the object, wherein the display functioncomprises enabling a touch sensitive function of the touch sensitivesurface of a display screen of the device, disabling the touch sensitivefunction of the touch sensitive surface, transitioning the displayscreen from an off state to an on state, or transitioning the displayscreen from the on state to the off state.
 21. The system of claim 14,wherein the object classification component is further configured toanalyze the touch surface information, the motion information, and atleast one other type of information, and determine the contactclassification for the object with respect to the touch sensitivesurface based at least in part on at least one result of the analyzing,and wherein the at least one other type of information comprises atleast one of orientation information relating to an orientation of thedevice or touch information relating to touching of a portion of thedevice by a user.
 22. The system of claim 14, wherein the motioninformation comprises previous motion information received prior to mostrecent motion information of the motion information, wherein the touchsurface information comprises capacitive information that includesprevious capacitive information received prior to most recent capacitiveinformation of the capacitive information, and wherein the objectclassification component is further configured to determine the contactclassification for the object with respect to the touch sensitivesurface based at least in part on the previous capacitive informationand the previous motion information.
 23. The system of claim 14, whereinthe object classification component is further configured to determinethe contact classification for the object with respect to the touchsensitive surface, based at least in part on a result of analyzingprevious classifications associated with the touch sensitive surface, todetermine the contact state of the object with respect to the touchsensitive surface.
 24. The system of claim 14, wherein the objectclassification component is further configured to determine one or moredescriptive features that are indicative of the object for at least onesubdivision of subdivisions of at least one of the touch surfaceinformation or the motion information, based at least in part on the atleast one result of the analyzing, and wherein the contactclassification for the object is determined based at least in part onthe one or more descriptive features, at least one location of the atleast one subdivision, and the motion information.
 25. The system ofclaim 14, wherein the object classification component is furtherconfigured to be trained to distinguish between a first type of contactwith the touch sensitive surface and at least one other type of contactwith the touch sensitive surface based at least in part on exampletraining classification samples comprising first positive exampletraining classification samples relating to the first type of contactand at least one other example positive training classification samplesrelating to the at least one other type of contact, and wherein thefirst type of contact relates to an ear of a user in contact with thetouch sensitive surface.
 26. The system of claim 14, further comprisinga buffer component configured to store at least one of a portion of thetouch surface information or the portion of the motion information, inresponse to the device being determined to be in an in-call state,wherein the object classification component retrieves, from the buffercomponent, and analyzes at least one of the portion of the touch surfaceinformation or the portion of the motion information.
 27. Anon-transitory machine-readable medium, comprising executableinstructions that, when executed by a processor, cause the processor toperform operations, comprising: examining characteristics of frame dataassociated with a touch sensitive surface that is associated with adevice and a subset of a set of motion data associated with at least oneaxis that is associated with the device, wherein a number of axes of themotion data to be included in the subset of the motion data isdetermined based at least in part on at least one of a time periodavailable to perform the examining, an amount of resources available toperform the examining, or a confidence level that is for an initialcontact classification for an object with respect to the touch sensitivesurface and is determined based at least in part on an intermediateresult of examining the frame data; and based at least in part on atleast one result of the examining, determining a contact classificationfor the object with respect to the touch sensitive surface to determinea contact state of the object with respect to the touch sensitivesurface.
 28. The non-transitory machine-readable medium of claim 27,wherein the operations further comprise: receiving the motion data fromat least one of an accelerometer, a gyroscope, an inertial measurementdevice, or a sensor, wherein the motion data is associated with morethan one axis, and wherein the motion data is indicative of the contactclassification to be associated with the object with respect to thetouch sensitive surface.